Commit Graph

604 Commits

Author SHA1 Message Date
bac41969a5 Optimise queries for rendering the users dashboard page
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 32s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m37s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-04-14 00:47:08 +10:00
d6e23b9a90 Optimise queries for rendering the about page
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 33s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m38s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-04-13 22:41:58 +10:00
2edc41b11e Support merging addresses when both src/dst addresses are in the seenby 2024-04-13 20:54:05 +10:00
03ca4c10b1 Only add items to the queue when the queue is empty 2024-04-12 21:22:27 +10:00
1e08c2f6f7 Move Domain_Controller::NUMBER_MAX to Address::ADDRESS_FIELD_MAX 2024-04-12 15:29:11 +10:00
cb09016539 Partially revert #9cf0f1e so that we create jobs by Address ID, not System ID 2024-01-10 16:58:35 +11:00
c1a1797778 If user information is not provided in a system update (for example when users update), then dont zap system_users 2023-12-20 17:18:10 +11:00
9376c6de11 We should check for subscription before checking for permissions 2023-12-20 11:20:48 +11:00
713615d8d5 Revert changes to CompressedString::class, messages were going out base64 encoded and compressed 2023-12-19 16:51:15 +11:00
01107cd3dc Added AnsiLove for rendering messages with ANSI sequences 2023-12-19 15:16:10 +11:00
c9d04b64ac Enabled NetmailPolicy, users can see netmail if they are in the seen-by, a ZC or admin 2023-12-19 12:55:27 +11:00
90206f2bb5 Enable admin setting user for a system 2023-12-19 12:55:27 +11:00
ac2ee7df0c Fix for netmail notifications, fftn_id wasnt being set correctly 2023-12-19 09:13:16 +11:00
24f6af3d3b Disabling our routine to set a default on an address, it needs to be improved 2023-12-19 08:54:26 +11:00
9c8e546765 Increase some logging for binkp sessions 2023-12-18 22:44:55 +11:00
13e51724c0 Further enhancement with #9063a2a - to ensure our message addressing and content picks the right address 2023-12-18 20:43:21 +11:00
1ded66990c Enable ZC to see netmail in their zone, and point owners to see their own netmail 2023-12-18 20:43:21 +11:00
fd07fb2be7 Include children in netmail for a host 2023-12-18 20:43:21 +11:00
e1c9fa12aa When rethrowing an exception, only include the message 2023-12-18 20:43:21 +11:00
7b9ab388d8 Optimise our use of items waiting and queries used. We are now using a single consistent query for each resource. 2023-12-18 20:43:21 +11:00
7af67de2a8 Fix scenario when creating a new BBS during user registration 'Attempt to read property exists on null' 2023-12-18 20:43:21 +11:00
27c050dc38 When we have multiple addresses, add we want a specific address, return the lowest role, or if strict mode enable, return the lowest role that is higher than the target 2023-12-18 20:43:21 +11:00
301fc33d2f HubStats was not limiting the scope to the date, now that the scopeUncollected..() methods dont limit by date (changed in #5a74386) 2023-12-18 20:43:21 +11:00
5d88a5e10e our_address() now takes a domain name - missed it for hub stats 2023-12-18 20:43:21 +11:00
aae551aacf Simplify packet processing. Re-enable pkt processing tests. 2023-12-18 20:43:21 +11:00
f6a6c13ca2 NCs should be /0 not /x 2023-12-18 20:43:21 +11:00
b9bc413b05 Fix for finding the TIC origin, it doesnt have a parent 2023-12-18 20:43:21 +11:00
caa6e629f4 Change Address::parent(),Address::children(), improved CI testing 2023-12-18 20:43:21 +11:00
541f612446 Improve our parent/children identification with points, fix our testing that was failing with NULLs and asserted out. Added zone:check so that's its easier to identify parent for FTNs 2023-12-11 18:31:38 +11:00
247cf614f3 Fix log note for PING netmails 2023-12-11 08:48:30 +11:00
ab5476d373 Remove deprecated Protocol:setClient() 2023-12-10 20:44:15 +11:00
0526500ff0 Integrate Mailer::class into System_Log::class, removed Zmodem Server/Client 2023-12-10 20:41:37 +11:00
8fc0336314 Fix for bugs implemented in #e56eca, where the message was including the 3 NULLs at the end and our header is near the end of a buffer read 2023-12-09 13:56:45 +11:00
5a74386f5a Optimisations to uncollected Items, which fix mail:send, which was only being triggered for mail unsent from yesterday 2023-12-08 15:16:49 +11:00
e56ecaa999 Fix for processing packets, where our EOM or EOP is split across buffer reads 2023-12-07 20:19:48 +11:00
fa2e74eaca Changes to timew() and wtime() to leverage last 2 bits for 4 year timestamp, making msgid checking valid according to FTSC. Added a test suite for timew()/wtime(). 2023-12-07 12:07:11 +11:00
1890b66dc7 Implemented Dynamic Items for data to be sent to polled systems based on data in db, like stats/nodelists 2023-12-03 18:51:46 +11:00
8f3d77b04d Implemented CLI areafix:rescan 2023-12-01 18:14:51 +11:00
049b2c7204 Change BINKP so that we send more packets in the same session, when we have more than msgs_pkt to send 2023-12-01 18:14:07 +11:00
5b7ec1a629 Add missing const to parent() and children() relations 2023-12-01 17:25:01 +11:00
535a082edd Enable overriding the DNS NS hostname 2023-11-28 19:57:47 +11:00
9cf0f1e2f4 Changed AddressPoll unique ID to be system_id, setup for memcached for all micrsoservices 2023-11-27 16:00:02 +11:00
27a3e3e24e Use ObjectIssetFix Trait instead of defining __isset() directly 2023-11-27 15:56:28 +11:00
8590bb8acc Fix the rendering of SEENBY/PATH lines in packets, which should have each new line prefixed with host 2023-11-27 09:00:32 +11:00
1ac3583479 Implemented system heartbeat, to poll systems regularly that we havent heard from 2023-11-26 14:59:05 +11:00
6e7e09ab50 Minor changes to mail:send and job:list rendering 2023-11-26 11:32:21 +11:00
2b2482ba71 Rework crash polling, using optimised scope queries 2023-11-25 21:52:05 +11:00
b5e5decfdf Processing packets on the command line can be archives as well 2023-11-25 09:48:37 +11:00
6abf10ab0b TIC and PKT passwords are case insensitive, so convert them to uppercase when we are using them 2023-11-25 09:47:58 +11:00
4070a060c3 Use created_at not datetime on status, since datetime may be wrong by the sender 2023-11-25 09:29:08 +11:00
a13497df5f Update domain::public() to only show public domains to admins, update status to be consistent with domain::public() 2023-11-25 00:10:21 +11:00
82cee02fa8 Dont included deleted_at items for the status 2023-11-24 23:39:38 +11:00
e337a29003 Determine unsent netmails by their flags, not sent_at for the status 2023-11-24 23:39:38 +11:00
eab35d4c18 On the status page, dont show inactive addresses, zones or domains 2023-11-24 23:39:38 +11:00
4c91ed54c0 First work on a status page showing nodes with uncollected mail 2023-11-24 23:39:38 +11:00
bed5bf8acc Binkp control frames can be NULL terminated. 2023-11-24 13:15:22 +11:00
0800c48928 Use regex for received file evaluation. Fixes recording received packet names 2023-11-23 23:17:13 +11:00
19338edcb6 Optimise the queries used to display packet contents and show DBID if msgid is not available 2023-11-23 21:55:39 +11:00
b3dfca5b89 Optimise BINKP msg processing by using ltrim instead of skip_blanks. Should also address taurus mailers that add a NULL to the end of ADR messages 2023-11-23 19:11:14 +11:00
76dc90ceb3 Fixes to TIC processing that uses the Address::ftn_regex 2023-11-23 13:17:02 +11:00
a13028808a Optimise our address FTN regex 2023-11-23 12:22:39 +11:00
e5de4970d1 When originating a session, send anything received via the queue 2023-11-23 08:31:24 +11:00
7847728e52 Remove autohold on successful poll 2023-11-22 18:15:06 +11:00
b8670a5593 Change our TIC mtime comparision to compare with the actual mtime of the TIC file 2023-11-22 17:25:48 +11:00
fbcbe2c5a8 Address part of packet names is in hex 2023-11-22 16:49:14 +11:00
5f11f81be3 Fixes for TICs for nodelists 2023-11-22 16:41:14 +11:00
9fd8264c3f Rework TIC processing and added test cases 2023-11-22 15:58:00 +11:00
5b24ff944f Change System::match to return a single item regardless of role 2023-11-22 13:59:19 +11:00
3221d7f679 Show packet info when viewing echomail 2023-11-22 13:59:19 +11:00
f639e3ffab New attempt to making sure echomails have origin and senders path/seenby details (rework of #45d7823) 2023-11-22 13:59:19 +11:00
e8f4bf93bd Add a dontqueue option to packet::process 2023-11-22 13:59:19 +11:00
116f726885 Fix helpers checking for wtime existance 2023-11-22 10:40:28 +11:00
3a0847f13a For DNS records that we resolve for, return nodata if we dont serve that data type 2023-11-22 10:40:28 +11:00
509cdd7ea6 Fix incorrect subjects on some notifications 2023-11-22 10:40:28 +11:00
45d78233b2 Disabling adding to path - its adding to the end of the path which is not correct 2023-11-22 10:40:28 +11:00
4a870b6587 Improvements to echomail path handling, ensuring sender and pktsrc are in the path 2023-11-22 10:40:28 +11:00
67747c062a Add mtime to receiving filename, so that we dont have name clashes with systems that use the same archive name for our host 2023-11-17 16:30:19 +11:00
250e584c03 Routed Netmails should still have the netmail dest address, not the hub's address 2023-11-15 22:56:26 +11:00
7087fe9bbb Throw an exception when we cannot determine the end of the message/packet 2023-11-15 22:12:09 +11:00
3b99c409e0 When a netmail has a msgid, dont overwrite it 2023-11-15 11:19:14 +11:00
ea42a347eb As per RFC 2308, add SOA to authoriative answers with nodata, or errors 2023-11-13 07:57:01 +11:00
85243d128e Fixes for TIC processing and not identifying path/seenby correctly 2023-10-29 21:28:29 +11:00
7d82cbcf12 Since we know the zone, we know the domain name when parsing addresses 2023-10-26 11:14:54 +11:00
a886a389a8 Fix for echomail notifications, when echomails come from a point. Auto detect address when manually processing packets. 2023-10-26 11:02:36 +11:00
f9d24db9f8 Minor changes to optimise new installs 2023-10-18 20:03:23 +11:00
a7e8cc7568 Implement HAPROXY proto support 2023-10-13 08:57:22 +11:00
c8ab8d3db3 Exported echomail should have the Hub as the OrigNet/OrigNode 2023-10-09 21:54:46 +11:00
b32020e60f Nodelist import debugging to make sure we do select nodelists correctly 2023-10-07 21:09:00 +11:00
2c504c3d66 Include receive timestamp in packet:info and now using Storage::disk to find file 2023-10-07 21:09:00 +11:00
df5cc8c2d4 TIC processing fixes, was unable to find TIC file 2023-10-07 21:09:00 +11:00
4616feacda Fix some redirects now that self::class,'home' is no longer defined 2023-10-07 21:09:00 +11:00
7a9b6d5015 Change network/ to domain/view/ 2023-10-07 21:09:00 +11:00
654e7bd2aa Remove remaining ftn/ paths, no functional changes 2023-10-07 21:09:00 +11:00
b25e6f432c Rework DomainController/UserController methods and paths, no functional changes 2023-10-07 21:09:00 +11:00
27985dbf0b Rework ZoneController methods and paths, no functional changes 2023-10-07 21:09:00 +11:00
fda68bba04 Rework SystemController methods and paths, no functional changes 2023-10-07 21:09:00 +11:00
c86d8d8952 Logging to catch some hex2bin exceptions with 2/109 2023-10-06 22:52:03 +11:00
614d332fae Add ifcico to DNS query responses 2023-10-06 22:52:03 +11:00
0cabdcd3c1 Still return TXT records even if a system doesnt have an address 2023-10-06 22:52:03 +11:00
495a27cfed Enhance the system link/register selection 2023-10-06 22:52:03 +11:00
32c0088339 Rework nodelist import and ignoring addresses that we manage 2023-10-06 22:52:03 +11:00
b854cf9fe0 Better catch TIC file exceptions, enable moving TIC files if fido.packet_keep is defined 2023-10-04 22:22:01 +11:00
ce7a96ca2a Logging cosmetic changes only in Zmodem 2023-10-04 22:06:16 +11:00
28e30a05e6 Make passwords mandatory 2023-10-04 16:26:05 +11:00
e75be34afd Detach users when deleting a system 2023-10-04 15:58:46 +11:00
d82f8ac8b3 Catch bad DNS queries and reduce exception logging 2023-10-04 15:50:24 +11:00
0fcb628c11 Non functional cosmetic updates 2023-10-04 15:49:44 +11:00
c7e707c143 Attempt to catch errors creating address for dovenet mail 2023-10-04 12:17:16 +11:00
62f0c1a909 DNS server now responds to SRV and TXT records 2023-10-03 23:15:21 +11:00
073d95f605 Reduce the exception noise with queries that we dont parse correctly 2023-10-03 20:58:23 +11:00
2a50a1d795 When we dont have session() details return a blank string instead of null 2023-10-03 09:17:30 +11:00
782acad560 When processing packets on the command line, send it to the queue 2023-09-27 11:19:36 +10:00
c0c8861c08 Fix for Serialization of 'finfo' is not allowed 2023-09-24 00:01:44 +10:00
d11a2a5b8d Update nodelist import to exclude systems managed by us 2023-09-23 23:15:42 +10:00
ff04de52b5 Rework TIC processing to use Storage::disk(). Implemented handling of replaces and files that already exist 2023-09-23 22:40:17 +10:00
2ae24b9955 Move fido configuation items into fido namespace. If keeping packets move them into a date aligned subdir 2023-09-22 15:35:08 +10:00
22c8b3df74 Respond to areafix netmails 2023-09-21 15:25:18 +10:00
b7c1c97cf7 Catch DNS Query that fail unpack() 2023-09-20 22:26:35 +10:00
612efda945 Process packet seenby/path/via lines when saving echomail/netmail 2023-09-20 21:37:18 +10:00
7fedf88d8c Hopefully a fix to stop clrghouz creating systems called Discovered System 2023-09-19 22:16:25 +10:00
11f9adf11a Fix seenby sort order, with flatten domains 2023-09-19 17:28:25 +10:00
eebe8a159d Fix address reported when scheduling a poll 2023-09-19 13:54:35 +10:00
3a35bce9e7 Changing System::match() to not include NC, some debugging updates 2023-09-19 11:29:08 +10:00
5e67be5ba1 Alert message for echomails with security violations is using wrong address 2023-09-19 11:29:08 +10:00
f315c71ca9 Fix path to public/logo 2023-09-19 11:29:08 +10:00
4343774079 Dont abort a session when there is an invalid FTN presented 2023-09-19 11:29:08 +10:00
eb40f94e37 Fix for binkd when remote present binkp protocol in brackets 2023-09-19 11:29:08 +10:00
cc04ddd7b3 More work to ensure messages from a node are valid for the domain, and fix domain flatten to check for zone if one is supplied 2023-09-17 15:54:47 +10:00
e611dcbe11 Filter available echoareas/fileareas based on security 2023-09-17 00:14:46 +10:00
073fa466d6 Added mail:list 2023-09-16 22:12:19 +10:00
708d9a9f67 More work to decommission rogue_path 2023-09-16 21:39:34 +10:00
c1d6d48a3c Dont enable rogue_path - it looses our true path for messages - instead create addresses in the path we dont know about. 2023-09-15 16:59:46 +10:00
6e133770fc An enhancement to ensure that flatten domains gets the correct FTN 2023-09-15 15:20:19 +10:00
a991db788e For AddressPoll, force using our file cache - seems sometimes the key doesnt release with memcached 2023-09-15 14:28:07 +10:00
096e37ef35 Removed packet cache, it wasnt used and not needed since we can queue large packets. Renamed to for consistent variable when using Packet::process() 2023-09-15 08:14:27 +10:00
2f878b6e64 Added filearea import 2023-09-14 23:42:25 +10:00
ec5c28a03e Added ignore_crc option to nodelist import 2023-09-14 23:06:02 +10:00
ff8c370d86 Move packet processing into a job 2023-09-13 20:58:22 +10:00
dc86d09894 Fix file receiving mtime being set 2023-09-13 15:54:53 +10:00
6fb31e2632 Logging to catch the mtime being set on received files 2023-09-13 14:57:36 +10:00
e07369c7a1 Debugging to determine why we create Discovered System 2023-09-12 21:21:09 +10:00
99866458a4 Limit where were respond to test messages 2023-09-12 17:46:32 +10:00
e553bb4ce6 Enable merging address in a domain that has flatten set 2023-09-11 23:25:00 +10:00
ab7f661800 Use FTN from origin as our primary address, and msgid if the origin line doesnt have one 2023-09-11 21:52:48 +10:00
673c444acd Implement 2D domain processing - mainly for fidonet 2023-09-10 22:48:12 +10:00
ed7dc2ab8b Added an address merge UI page 2023-09-09 21:16:51 +10:00
67c1be209d Logging changes when processing TIC files 2023-09-09 00:10:45 +10:00
6d199345ac Enable nodelist import test mode 2023-09-09 00:10:45 +10:00
7b39dafd12 Change verbosity of TCP read/sent to debug 2023-09-08 21:04:24 +10:00
ed43aaa878 Fix for DNS query's using the domain's dnsdomain 2023-09-08 21:04:24 +10:00