Commit Graph

381 Commits

Author SHA1 Message Date
9d7455233b Improvements for finding intransit netmails to upstream and peer hubs 2024-09-09 08:23:40 +10:00
62a9139d14 Fix packet processing issue - we now find recent deleted address when creatingFTN, fix netmail processing with points, fix processing badly address netmails
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 35s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m52s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-07-12 12:47:50 +10:00
4d7af7c7e3 Store datetime in UTC format now, and fix presentation of TZUTC. Also standardise message summaries on Notifications
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 42s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m51s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-28 23:27:06 +10:00
fc930ba6c2 Revert "Fix date being used in mail packets, timezone was effectively being to a timestamp with the timezone already"
This function is used to get the true date of a message (taking into account the TZ), and needed when creating the TZUTC

This reverts commit ad0ad73b0c.
2024-06-28 18:30:34 +10:00
d25dae2427 Make debug logging of binkd consistent with other logging statements 2024-06-28 15:31:30 +10:00
cfb408766f Fix for bug introduced in 7c23971 that was affecting transfers with binkd nodes
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-28 05:28:35 +00:00
b9603e4bb8 Changing File/Send debugging to make it clear it is content read/open, not a network read/open
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 36s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-27 15:27:16 +10:00
df07d9978e Fix for when Address::createFTN refuses to create an address
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-27 09:54:03 +10:00
f006d829f4 Fix for originating calls and not recognising that the remote accepted our password
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 37s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m45s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-06-27 09:09:47 +10:00
6374725e8e Added debugging for our read buffer, for problem debugging
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 37s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-27 08:57:00 +10:00
e2321f3acd Including size in debugging messages for items being sent
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 35s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m48s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-27 08:36:14 +10:00
d8c68bcaa2 Change DNS logging, especially around missing details
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 37s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m50s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-27 08:20:52 +10:00
a82927c1f6 Reduce DNS query debugging
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 36s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-26 23:56:30 +10:00
b62f18cf3d Remove protocol checking for validated, presented akas are now by definition valid
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m47s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-26 23:42:25 +10:00
b88046d57e Record AKA we are sending to, not system name
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 35s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m48s
Create Docker Image / Final Docker Image Manifest (push) Successful in 8s
2024-06-26 23:11:08 +10:00
d3c8bc844a Fix calls to deprecated getDateAttribute() for mail packets
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m47s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-26 22:44:31 +10:00
b891abb611 Netmail waiting query optimisation, increase logging on what we have for a node
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 43s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m53s
Create Docker Image / Final Docker Image Manifest (push) Successful in 8s
2024-06-26 22:37:38 +10:00
7c23971e58 Recognise all AKAs for a system when we are polling it with one of it's AKAs in a domain 2024-06-26 16:03:58 +10:00
91d4cd0b2f Lower the severity of a message when an AKA is not in our domain 2024-06-26 16:02:26 +10:00
db8475053c Attempt to catch Sending we got an EXCEPTION when in maintenance mode
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 40s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m50s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-26 12:18:06 +10:00
ad0ad73b0c Fix date being used in mail packets, timezone was effectively being to a timestamp with the timezone already
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 37s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m49s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-25 13:09:48 +10:00
11b7dc4229 Fix presenting PATH/SEENBY when point_id is null
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 36s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m47s
Create Docker Image / Final Docker Image Manifest (push) Successful in 9s
2024-06-25 11:20:08 +10:00
7bd192980f Fix file sending, as a result of moving $size into Send::class when optimising mail sending 2024-06-25 11:20:08 +10:00
1b2358b5a9 Mail bundling and processing performance improvements
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 48s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m57s
Create Docker Image / Final Docker Image Manifest (push) Successful in 12s
2024-06-21 09:09:50 +10:00
c28392b2b6 Remove deprecated methods
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m48s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-15 18:29:55 +10:00
df2873287c Abstract address session() details 2024-06-15 18:29:55 +10:00
0304967e80 Missed removing methods as a result of removing EncodeUTF8 in 29710c37 2024-06-13 20:34:42 +10:00
ba0f643dca Improvements to e692de7, which wasnt picking up netmail alerts
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m51s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-06-09 21:14:27 +10:00
829fe1d7a9 Dont accept connections when application down
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-07 18:07:34 +10:00
67377a2012 Clear messages from sent packet
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-06-07 11:12:06 +10:00
e692de7d7f When limiting the number of messages in a packet, only retrieve that number from the DB
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 36s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m44s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-06-07 10:51:28 +10:00
06c29d8750 Updates to Message, Remove updated_at/mid from echomails/netmails, not used
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 35s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m47s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-06-07 08:54:49 +10:00
8fb3a21fcd Normalise tagline/tearline/origin
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m51s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-06-03 19:09:09 +10:00
0bc3d4cf60 Downgrade DNS query errors, since they are handled 2024-06-03 19:09:09 +10:00
38795b83bf Move HAproxy exceptions into their own class, and downgrade HAproxy errors since they are handled 2024-06-03 19:09:09 +10:00
27fe3cd223 Fix message processing when tag/tear lines dont start with double \r
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m54s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-30 20:14:50 +10:00
364815e8af Setup to present different mail bundle types 2024-05-28 12:23:59 +10:00
b102fc4d2a Fix creating a new discovered address and setting validated to true
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m42s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-27 18:04:04 +10:00
fe18968c57 Show node status with Hub Stats 2024-05-26 21:50:13 +10:00
f8cb6ccc37 Automatically mark idle nodes HOLD/DOWN/DE-LIST. Automatically validate presented addresses.
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m43s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-25 22:31:42 +10:00
2f24e13940 Dont add a MSGID kludge if there isnt one
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m44s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-25 00:43:44 +10:00
87f495b326 Add nodelist segment creation
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 38s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m43s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-24 17:09:10 +10:00
1615b413a7 Assume f0 for DNS queries that dont pass an f in the query
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 39s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m40s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-24 12:34:28 +10:00
4f8448563d Fix for when adding our address to path for outgoing echomails - introduced in 5fc6906
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m46s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-23 17:38:18 +10:00
5fc69067fb Fix sorting of seenby/path items in echomail/netmail. Add rogue_seenby to seenby in echomail 2024-05-23 17:37:46 +10:00
dc212d35fb Work to handle grunged packets as well as look for tearline/tagline/orgin line from the end of the content
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 40s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m44s
Create Docker Image / Final Docker Image Manifest (push) Successful in 11s
2024-05-22 23:24:29 +10:00
3ce6a8ed61 Record the AKAs presented 2024-05-22 22:12:38 +10:00
a5e9a28673 Added PRODUCT_NAME_SHORT and updated PID/TID kludge to include git hash
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m43s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-22 15:31:10 +10:00
924d760c79 Fix FSC45 packets, point_id was still being validated the old way 2024-05-22 09:21:59 +10:00
b20878e378 Kludges are not required in messages 2024-05-22 09:21:59 +10:00
b443762739 Fix processing echomail and when mail crc is calculated as it was decompressing the CompressedString 2024-05-22 09:21:59 +10:00
17e3c69f07 Fix for invalid-zone validation comparing a string with an int 2024-05-22 09:21:59 +10:00
8df6384736 Fixed checking for RESCAN kludge 2024-05-22 09:21:59 +10:00
72d68fa1ab Update SocketClient to support raw IP addresses 2024-05-22 09:21:59 +10:00
ab2e288f06 More complete rework of packet parsing and packet generation with f279d85 - and testing passes 2024-05-22 09:21:59 +10:00
f279d85b08 More complete rework of packet parsing and packet generation with 29710c 2024-05-19 23:28:45 +10:00
46f52dd56d Only auth AKAs in the same domain as us 2024-05-18 12:26:00 +10:00
29710c37c2 Complete rework of packet parsing and packet generation 2024-05-17 22:10:54 +10:00
0457b3df25 Resorting methods, no functional changes 2024-05-13 18:55:39 +10:00
4fe5dc6ad0 Fix for session being reported negative 2024-05-12 21:56:46 +10:00
556b95c7c1 Fix when dispatching packets, and our address object has many relations already loaded, causing memory exhaustion due to recursion 2024-05-12 21:56:46 +10:00
14c505c15b Must not cache the mail waiting queries, otherwise mail/files will be resent in a query loop
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 41s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m42s
Create Docker Image / Final Docker Image Manifest (push) Successful in 12s
2024-05-12 14:56:18 +10:00
23159d19d5 Rework address roles, making Address::role optional, rework determining uplink/downlinks/parent/children 2024-05-09 21:22:30 +10:00
b17fe1d2ee It seems session time is now returning a float, cast it to an int
All checks were successful
Create Docker Image / Build Docker Image (x86_64) (push) Successful in 34s
Create Docker Image / Build Docker Image (arm64) (push) Successful in 1m40s
Create Docker Image / Final Docker Image Manifest (push) Successful in 10s
2024-05-05 17:41:47 +10:00
bba6f93fbc Code improvement to our_address(), reducing arguments 2024-04-21 21:40:55 +10:00
a2ff2df9f3 Move security evaluations for File/Echoareas back to model 2024-04-16 21:28:35 +09:30
03ca4c10b1 Only add items to the queue when the queue is empty 2024-04-12 21:22:27 +10:00
1e08c2f6f7 Move Domain_Controller::NUMBER_MAX to Address::ADDRESS_FIELD_MAX 2024-04-12 15:29:11 +10:00
9c8e546765 Increase some logging for binkp sessions 2023-12-18 22:44:55 +11:00
13e51724c0 Further enhancement with #9063a2a - to ensure our message addressing and content picks the right address 2023-12-18 20:43:21 +11:00
e1c9fa12aa When rethrowing an exception, only include the message 2023-12-18 20:43:21 +11:00
7b9ab388d8 Optimise our use of items waiting and queries used. We are now using a single consistent query for each resource. 2023-12-18 20:43:21 +11:00
27c050dc38 When we have multiple addresses, add we want a specific address, return the lowest role, or if strict mode enable, return the lowest role that is higher than the target 2023-12-18 20:43:21 +11:00
301fc33d2f HubStats was not limiting the scope to the date, now that the scopeUncollected..() methods dont limit by date (changed in #5a74386) 2023-12-18 20:43:21 +11:00
5d88a5e10e our_address() now takes a domain name - missed it for hub stats 2023-12-18 20:43:21 +11:00
aae551aacf Simplify packet processing. Re-enable pkt processing tests. 2023-12-18 20:43:21 +11:00
ab5476d373 Remove deprecated Protocol:setClient() 2023-12-10 20:44:15 +11:00
0526500ff0 Integrate Mailer::class into System_Log::class, removed Zmodem Server/Client 2023-12-10 20:41:37 +11:00
8fc0336314 Fix for bugs implemented in #e56eca, where the message was including the 3 NULLs at the end and our header is near the end of a buffer read 2023-12-09 13:56:45 +11:00
e56ecaa999 Fix for processing packets, where our EOM or EOP is split across buffer reads 2023-12-07 20:19:48 +11:00
1890b66dc7 Implemented Dynamic Items for data to be sent to polled systems based on data in db, like stats/nodelists 2023-12-03 18:51:46 +11:00
049b2c7204 Change BINKP so that we send more packets in the same session, when we have more than msgs_pkt to send 2023-12-01 18:14:07 +11:00
535a082edd Enable overriding the DNS NS hostname 2023-11-28 19:57:47 +11:00
27a3e3e24e Use ObjectIssetFix Trait instead of defining __isset() directly 2023-11-27 15:56:28 +11:00
8590bb8acc Fix the rendering of SEENBY/PATH lines in packets, which should have each new line prefixed with host 2023-11-27 09:00:32 +11:00
1ac3583479 Implemented system heartbeat, to poll systems regularly that we havent heard from 2023-11-26 14:59:05 +11:00
6abf10ab0b TIC and PKT passwords are case insensitive, so convert them to uppercase when we are using them 2023-11-25 09:47:58 +11:00
bed5bf8acc Binkp control frames can be NULL terminated. 2023-11-24 13:15:22 +11:00
0800c48928 Use regex for received file evaluation. Fixes recording received packet names 2023-11-23 23:17:13 +11:00
b3dfca5b89 Optimise BINKP msg processing by using ltrim instead of skip_blanks. Should also address taurus mailers that add a NULL to the end of ADR messages 2023-11-23 19:11:14 +11:00
e5de4970d1 When originating a session, send anything received via the queue 2023-11-23 08:31:24 +11:00
7847728e52 Remove autohold on successful poll 2023-11-22 18:15:06 +11:00
b8670a5593 Change our TIC mtime comparision to compare with the actual mtime of the TIC file 2023-11-22 17:25:48 +11:00
5f11f81be3 Fixes for TICs for nodelists 2023-11-22 16:41:14 +11:00
9fd8264c3f Rework TIC processing and added test cases 2023-11-22 15:58:00 +11:00
3a0847f13a For DNS records that we resolve for, return nodata if we dont serve that data type 2023-11-22 10:40:28 +11:00
67747c062a Add mtime to receiving filename, so that we dont have name clashes with systems that use the same archive name for our host 2023-11-17 16:30:19 +11:00
7087fe9bbb Throw an exception when we cannot determine the end of the message/packet 2023-11-15 22:12:09 +11:00
ea42a347eb As per RFC 2308, add SOA to authoriative answers with nodata, or errors 2023-11-13 07:57:01 +11:00
a7e8cc7568 Implement HAPROXY proto support 2023-10-13 08:57:22 +11:00