Commit Graph

387 Commits

Author SHA1 Message Date
9fd8264c3f Rework TIC processing and added test cases 2023-11-22 15:58:00 +11:00
3a0847f13a For DNS records that we resolve for, return nodata if we dont serve that data type 2023-11-22 10:40:28 +11:00
67747c062a Add mtime to receiving filename, so that we dont have name clashes with systems that use the same archive name for our host 2023-11-17 16:30:19 +11:00
7087fe9bbb Throw an exception when we cannot determine the end of the message/packet 2023-11-15 22:12:09 +11:00
ea42a347eb As per RFC 2308, add SOA to authoriative answers with nodata, or errors 2023-11-13 07:57:01 +11:00
a7e8cc7568 Implement HAPROXY proto support 2023-10-13 08:57:22 +11:00
c8ab8d3db3 Exported echomail should have the Hub as the OrigNet/OrigNode 2023-10-09 21:54:46 +11:00
b32020e60f Nodelist import debugging to make sure we do select nodelists correctly 2023-10-07 21:09:00 +11:00
df5cc8c2d4 TIC processing fixes, was unable to find TIC file 2023-10-07 21:09:00 +11:00
c86d8d8952 Logging to catch some hex2bin exceptions with 2/109 2023-10-06 22:52:03 +11:00
614d332fae Add ifcico to DNS query responses 2023-10-06 22:52:03 +11:00
0cabdcd3c1 Still return TXT records even if a system doesnt have an address 2023-10-06 22:52:03 +11:00
b854cf9fe0 Better catch TIC file exceptions, enable moving TIC files if fido.packet_keep is defined 2023-10-04 22:22:01 +11:00
ce7a96ca2a Logging cosmetic changes only in Zmodem 2023-10-04 22:06:16 +11:00
d82f8ac8b3 Catch bad DNS queries and reduce exception logging 2023-10-04 15:50:24 +11:00
0fcb628c11 Non functional cosmetic updates 2023-10-04 15:49:44 +11:00
62f0c1a909 DNS server now responds to SRV and TXT records 2023-10-03 23:15:21 +11:00
073d95f605 Reduce the exception noise with queries that we dont parse correctly 2023-10-03 20:58:23 +11:00
c0c8861c08 Fix for Serialization of 'finfo' is not allowed 2023-09-24 00:01:44 +10:00
ff04de52b5 Rework TIC processing to use Storage::disk(). Implemented handling of replaces and files that already exist 2023-09-23 22:40:17 +10:00
2ae24b9955 Move fido configuation items into fido namespace. If keeping packets move them into a date aligned subdir 2023-09-22 15:35:08 +10:00
22c8b3df74 Respond to areafix netmails 2023-09-21 15:25:18 +10:00
b7c1c97cf7 Catch DNS Query that fail unpack() 2023-09-20 22:26:35 +10:00
612efda945 Process packet seenby/path/via lines when saving echomail/netmail 2023-09-20 21:37:18 +10:00
3a35bce9e7 Changing System::match() to not include NC, some debugging updates 2023-09-19 11:29:08 +10:00
4343774079 Dont abort a session when there is an invalid FTN presented 2023-09-19 11:29:08 +10:00
eb40f94e37 Fix for binkd when remote present binkp protocol in brackets 2023-09-19 11:29:08 +10:00
708d9a9f67 More work to decommission rogue_path 2023-09-16 21:39:34 +10:00
c1d6d48a3c Dont enable rogue_path - it looses our true path for messages - instead create addresses in the path we dont know about. 2023-09-15 16:59:46 +10:00
6e133770fc An enhancement to ensure that flatten domains gets the correct FTN 2023-09-15 15:20:19 +10:00
096e37ef35 Removed packet cache, it wasnt used and not needed since we can queue large packets. Renamed to for consistent variable when using Packet::process() 2023-09-15 08:14:27 +10:00
ff8c370d86 Move packet processing into a job 2023-09-13 20:58:22 +10:00
dc86d09894 Fix file receiving mtime being set 2023-09-13 15:54:53 +10:00
6fb31e2632 Logging to catch the mtime being set on received files 2023-09-13 14:57:36 +10:00
e07369c7a1 Debugging to determine why we create Discovered System 2023-09-12 21:21:09 +10:00
99866458a4 Limit where were respond to test messages 2023-09-12 17:46:32 +10:00
ab7f661800 Use FTN from origin as our primary address, and msgid if the origin line doesnt have one 2023-09-11 21:52:48 +10:00
673c444acd Implement 2D domain processing - mainly for fidonet 2023-09-10 22:48:12 +10:00
67c1be209d Logging changes when processing TIC files 2023-09-09 00:10:45 +10:00
7b39dafd12 Change verbosity of TCP read/sent to debug 2023-09-08 21:04:24 +10:00
ed43aaa878 Fix for DNS query's using the domain's dnsdomain 2023-09-08 21:04:24 +10:00
485d67b366 Enable binkp non-secure mode 2023-09-08 21:04:24 +10:00
005aa88514 Fix for App\Classes\File\Tic::close must be compatible with parent 2023-09-08 21:04:24 +10:00
6498e364fb More TIC processing fixes 2023-09-08 21:04:24 +10:00
63a9c06fb0 Fix for bug introduced in previous commit, where tic files where queued without the address prefix 2023-09-07 12:25:44 +10:00
1e17aed170 Debugging to try and catch address creation exception (because of two active addresses) 2023-09-04 14:15:53 +12:00
61582fa4da Fix for when we have a duplicate FTN and we are logging that - Attempt to read property ftn on string 2023-09-04 12:11:20 +12:00
5a62d69913 When reading from remote with a timeout, return NULL if nothing received 2023-08-10 11:11:47 +10:00
74a56d1e17 Now correctly showing packet receive time, and sending Notifications based on the packet address, not the node address 2023-08-06 13:43:10 +10:00
c8a2affbfa Fix for when packets have a kludge after the origin line, and now capturing taglines. Updated testing configuration 2023-08-05 15:19:10 +10:00
944ae41fba Record some todo's 2023-07-29 13:17:59 +10:00
f1ccca25ea Change public to show on echo/file areas to enable limiting whats shown in the activity graph 2023-07-28 13:22:39 +10:00
4e44e2e266 Added system polling 2023-07-26 19:44:07 +10:00
c23b5ebfc2 Minor changes to thin font 2023-07-25 23:14:33 +10:00
17fe7e910d Multiple enhancements to interactive messages, moved messages to Notifications, send netmail back when invalid packet password 2023-07-23 20:21:02 +10:00
9f0fa0a8ec Fix Page::class and rendering 2023-07-23 18:44:39 +10:00
02a3963a12 Fix netmail flags for netmails originating here 2023-07-20 23:12:26 +10:00
8d9bde9692 Fix messages to points, and fix netmail coming from systems which dont include an Origin line 2023-07-20 22:16:38 +10:00
e1169335be Fix for when NR mode is active 2023-07-19 16:38:41 +10:00
f9a74578ff Fix for large packet transfer, since we were evaluating with the wrong size 2023-07-19 16:24:35 +10:00
f4fc6c24a4 Move the send DB updates out of the protocol and into Send::class 2023-07-19 12:32:41 +10:00
7584e3e44e Fix for received bytes, when packets have been processed 2023-07-19 10:49:57 +10:00
dcae06aad9 Change DEBUG to a static const 2023-07-19 10:27:47 +10:00
ee03604de3 Fixes to EMSI/ZModem as a result of previous enhancements to items 2023-07-18 23:00:13 +10:00
c1ec4eff36 Optimised our sending and receiving of items 2023-07-18 23:00:13 +10:00
a3302b4012 Complete of logging received and sent packet names, and display them in the web ui for each node 2023-07-15 22:10:05 +10:00
61ab0614b6 Correctly storing netmail flags (intransit, local, recv) with senders ID and packet name 2023-07-15 10:46:19 +10:00
7bf957df3a Sending Mail now dynamically creates packet name, size and mtime 2023-07-14 20:03:09 +10:00
28101237e8 Fixes for CRYPT, NOREL and MULTIBATCH when responding in server mode 2023-07-12 23:34:01 +10:00
b37c6407fb Fix for incorrectly batching up more mail after EOB, if MULTIBATCH is not agreed 2023-07-11 21:34:47 +10:00
5516b5dc23 Fixes for BINKP, we were sending too many EOB's 2023-07-11 17:22:31 +10:00
029ec9c209 Only consider NR mode if the offset presented is -1 2023-07-09 22:19:11 +10:00
d4439a6b58 Dont send an M_GET when we are not in NR mode, or we are offered a file from a zero offset. 2023-07-09 11:18:57 +10:00
faeec61aeb Fix for limiting AKAs, show parent PID that forked child, other minor fixes 2023-07-08 18:00:23 +10:00
02105b10fb Fix EMSI sessions, buffer_clear() was renamed tx_purge() 2023-07-08 17:36:41 +10:00
ccdce6bb62 Move mailer details into a separate table 2023-07-07 23:59:04 +10:00
ad4ea699a5 Fix BINKP transfers when tcp buffer has more chars than we need at that point in time 2023-07-07 23:13:43 +10:00
30c11956dd Remove some debugging left from previous commits, fix Address::scopeTrashed(), change display of BBS list 2023-07-07 22:42:02 +10:00
36d03d1c12 Fix for region_id when importing messages and the address exists in a different region 2023-07-06 13:55:54 +10:00
d6aafa4322 Changes to phone, add Active/Archive to echomail list for nets 2023-07-06 11:55:54 +10:00
0f7a42c503 Enabled configuration of EMSI tunables in setup 2023-07-06 09:20:33 +10:00
c3d4c1fc31 Enable full setup on the setup form 2023-07-05 22:58:24 +10:00
6f298d778f Some BINKP optimisation, implemented crypt, implemented receiving compressed transfers 2023-07-05 19:38:50 +10:00
f9f9fb5345 Improve debugging and code optimisations for Socket operations 2023-07-04 11:33:28 +10:00
ad36da0bb1 Code cleanup, no functional changes 2023-07-04 11:33:28 +10:00
75549590fc Enable systems to configure their packet type 2023-06-26 21:24:24 +12:00
a26f61d75d Define and detect different packet types (2,2e,2+,2.2) 2023-06-26 21:24:24 +12:00
b8534d8598 Make filename unique for each area, rename column to name/lname for files 2023-06-23 17:33:47 +10:00
b1b86ca04a Implemented file sending during BINKP and EMSI sessions 2023-06-22 22:13:47 +10:00
58341db0fb Show netmails to admins, record netmail path in the DB 2023-06-18 23:33:26 +10:00
e3f2d6cf15 Fix EMSI TRX time - force it to be local time 2023-06-17 11:37:59 +10:00
b41d65a8fd Fix SocketClient checking for more data, now that we buffer received data 2023-06-16 23:18:35 +10:00
ccf01a1b23 Enhancements to DNS server and notes for usage with bind 2023-06-12 23:19:50 +10:00
b1c62ae227 Update SocketClient to support UDP. Change DNS queries to use SocketClient 2023-06-11 22:18:52 +10:00
b1d522d8cc Added DNS server 2023-04-22 21:30:30 +10:00
Deon George
51e915b73d Fix for EMSI timezone and add MOH# 2023-02-12 13:30:07 +11:00
Deon George
d949737608 Fix authentication for originating EMSI session with known systems 2023-02-11 23:06:13 +11:00
Deon George
3dc18a3f1f Change default internal caching to off, and added test to make sure things are cached if on. More debugging with packet name for netmails 2023-01-25 16:26:10 +11:00
Deon George
63e3397aee Add packet name for incoming netmails, dont send back messages to sender for areafix messages 2023-01-24 23:16:11 +11:00
Deon George
bc19f9aa82 Increase logging on the type of file if it isnt a mail packet 2023-01-24 22:03:17 +11:00
Deon George
d9b575b38f Change our determination that a packet has been processed before deciding to delete it 2023-01-24 22:03:17 +11:00
Deon George
dac880b689 Ignore case when checking if a file is a PKT file 2023-01-24 22:03:17 +11:00
Deon George
3392092131 Some comments for binkd 2023-01-11 14:36:40 +11:00
Deon George
724bc4c5af Dont abort on an SQL exception 2023-01-11 14:36:40 +11:00
Deon George
4016775b66 Improved display of bad packets 2023-01-11 14:36:40 +11:00
Deon George
109beb4f4f Enable processing messages coming from a domain with multiple zones 2023-01-02 23:31:31 +11:00
Deon George
c1ab14f2e6 Fix echoarea display with the oldest message 2023-01-01 14:33:52 +11:00
Deon George
6c97eb2d81 Fix for when TZUTC is gibberish, and use file hexdump in pkt debug 2023-01-01 12:02:28 +11:00
Deon George
0e7b93abd1 Fix to make sure we resend the EMSI_REQ banner 2022-12-31 15:13:17 +11:00
Deon George
f089f3bcdc Dont delete archive until all packets processed 2022-12-04 21:59:06 +11:00
Deon George
4d3d57fdcd Fix EMSI session undefined, other minor cosmetic code changes 2022-12-04 20:45:33 +11:00
Deon George
05528f1c33 More work on user linking to existing defined system 2022-12-04 13:30:38 +11:00
Deon George
14f28c5263 Fix packet parsing for unknown zones, or zones that are not default 2022-12-03 16:00:38 +11:00
Deon George
a897852072 Fix binkp M_nul OPT parsing 2022-12-03 15:30:31 +11:00
Deon George
09fe65a8db EMSI Continue sending mail until no more mail to send 2022-12-03 01:25:44 +11:00
Deon George
e78b5975b0 Reduce zmodem debugging 2022-12-03 01:25:44 +11:00
Deon George
170f5c87ed Log systems polling 2022-12-03 01:25:44 +11:00
Deon George
d5d4a0d781 Auto create Domains/Zones as systems present their AKAs to us 2022-12-03 01:25:44 +11:00
Deon George
216bd1a2cd Sometimes guessExtension doesnt return bin for pkt's 2022-11-15 22:13:31 +11:00
Deon George
4e66990826 Fix processing packets when we loop without reading 2022-11-15 22:01:05 +11:00
Deon George
3ffb1c1fd6 Support for ZIP archives 2022-11-14 00:29:55 +11:00
Deon George
e7ebaa85cb Fix nodelist crc's that have 8 chars 2022-11-13 15:17:22 +11:00
Deon George
eab36c1603 Create TO ftn (for netmails), identify REPLYID, add file:list 2022-11-11 22:57:40 +11:00
Deon George
6284016400 Auto create FTN address for intransit netmail when the destination is not known. 2022-11-06 14:40:03 +11:00
Deon George
9a8ee1aa2b Fix packets with null values in the date, and exceptions not catching it 2022-11-05 19:17:37 +11:00
Deon George
c7187dbb0e Fix casting on compressed attributes when value is NULL, reduce some BINKP debugging messages 2022-11-05 15:17:11 +11:00
Deon George
9721db185b Ensure Echomail is initialised correctly 2022-11-05 10:17:14 +11:00
Deon George
34f289953d Implementation fixes for TIC processing 2022-11-05 10:17:14 +11:00
Deon George
7571a2cd7d Enable moving inbound files to s3 and logging in DB 2022-11-04 17:30:18 +11:00
Deon George
029a8a9d73 Added file areas and TIC processing 2022-11-02 22:01:45 +11:00
Deon George
0fe65d6187 Change gethostbyname() with dns_get_record() 2022-03-25 21:50:58 +11:00
Deon George
8072f7c5a9 Work on registration of existing systems to users 2022-03-20 22:42:11 +11:00
Deon George
6db16712ee Fix passthrough netmail. 2022-02-19 17:03:12 +11:00
Deon George
daba4a78d3 Fix echoarea name is converted to UC, add netmail VIA lines for outgoing netmail 2022-02-17 23:55:37 +11:00
Deon George
f216f42917 Minor cosmetic changes, show hex_dump when data purged from protocol stream 2022-02-13 11:27:23 +11:00
Deon George
f142284a2b Understand some gated messages, that are gated from a different zone 2022-02-12 11:35:24 +11:00
Deon George
d1bfa3a035 Fix for trying to receive a new file, when the previous file open failed with a permission denied 2022-02-06 20:40:21 +11:00
Deon George
a05ca1c2a4 Misc bug fixes while testing 2022-02-06 20:40:21 +11:00
Deon George
b65289af9f Enable binding ports for IPv6 2022-02-03 13:23:58 +11:00
Deon George
d660d5a6df Move DomainController::NODE* to Address::NODE*, make role mandatory in the database, change logic so that mail generated by the host comes from a node address. 2022-02-03 13:23:58 +11:00
Deon George
efa7195633 Add DBID back to messages, add path/seen-by to generated messages, other minor cosmetic fixes 2022-01-22 23:08:46 +11:00
Deon George
fe9fbb88b0 Fix packet name sent to remote - now matches packet name stored in DB 2022-01-20 23:25:47 +11:00
Deon George
98c9b880d4 Some debugging to track packet names created for sending 2022-01-20 22:47:44 +11:00
Deon George
421cd565bd Enable us to create an outbound packet without updating send details. Determine the send address for packets earlier 2022-01-20 17:54:02 +11:00
Deon George
c7e6bb2575 Enable system mail hold 2022-01-16 11:51:49 +11:00
Deon George
6f1d47a6ab Fixes to message processing, now that we are using cockroachdb 2022-01-15 17:11:51 +11:00
Deon George
424d6ef39d Switchout DB to CockroachDB 2022-01-15 14:58:41 +11:00
Deon George
fa2ac9a656 Changes to Authorisation for users to edit systems, minor cosmetic fixes and more logging 2021-12-29 13:44:27 +11:00
Deon George
bf57f151d5 Attempt to catch invalid FTN addresses while parsing packets 2021-12-01 23:41:20 +11:00
Deon George
3a1c6d55c6 Enable UTF8 encoding to/from as well in messages 2021-12-01 22:45:51 +11:00
Deon George
f1780e61ea Some messages have the origin in the middle of the message - change strpos to strrpos 2021-11-29 21:12:44 +11:00
Deon George
a00534794e Another fix for when packets contain binary messages with SOH chars. 2021-11-29 00:12:37 +11:00
Deon George
880ff81eff Fix for when packets contain binary messages with SOH chars. Added testing for packet parsing 2021-11-28 22:41:07 +11:00
Deon George
b35655a163 Page rendering using ANSI support 2021-11-27 00:40:12 +11:00
Deon George
871430edf8 Replace path from duplicate messages when the existing path is blank 2021-11-25 21:22:36 +11:00
Deon George
ebd1cf8732 Enable duplicates to update seen-by's before being discarded 2021-11-24 22:34:40 +11:00
Deon George
02c23f047c Fix for recording seen-by, add md5 to message body, fix incorrect log of dispatching messages 2021-11-21 16:53:56 +11:00
Deon George
8c127ba5da
Try not abort on exception when we cannot dispatch a message to be processed 2021-10-26 17:51:17 +11:00
Deon George
cabf9bca8b Fix for corrupt packets and the object is not properly initialised 2021-10-25 21:09:57 +11:00
Deon George
b246f0051f Fix polling, presenting our address. Fix logging address. 2021-10-18 23:08:08 +11:00
Deon George
83e06908b0 Multiple exception bug fixes identified during testing 2021-10-07 23:32:37 +11:00
Deon George
fa97fbb0c1 Fix responding to echomail from points 2021-10-02 10:03:17 +10:00
Deon George
eda0926758 Added converting ANSI to a binary format, and custom font rendering 2021-10-02 10:03:17 +10:00
Deon George
82e3283d6d Move address polling to a Job, better catch Socket connection refused errors 2021-09-20 20:39:03 +10:00
Deon George
8b8b513ed1 Add kludge to Test responses 2021-09-14 23:14:13 +10:00
Deon George
2cd6db2060 Dont launch bot processing for rescanned messages 2021-09-13 23:02:39 +10:00
Deon George
79e613a811 Allow for origin/tagline/tearline can have UTF8 chars, show # messages in packets 2021-09-12 23:06:17 +10:00
Deon George
5e8b590f17 Move process functions to Netmail/Echomail folders, optimize Netmail creation when processing messages 2021-09-12 22:14:04 +10:00
Deon George
f91778b515 Fix for when msgid address is from an unknown zone 2021-09-12 22:09:45 +10:00
Deon George
fcdde10512 Auto create nodes that are discovered by message packets 2021-09-11 23:32:10 +10:00
Deon George
7e176d7bc1 Fix for unknown FTN when connection is not established, try and catch unknown socket exception during session initialisation 2021-09-11 11:47:26 +10:00
Deon George
e8a9508391 Ping/Test send/recevied time was switched 2021-09-10 22:27:00 +10:00
Deon George
fbfa2d5183 Fix Cannot assign null to property when tagline/tearline are blank during export 2021-09-08 22:53:27 +10:00
Deon George
03c4b87cdd Fix packet password on exports, move __unserialize() to EncodeUTF8::decode 2021-09-08 22:07:19 +10:00
Deon George
dbbfe46cb9 Echomail export 2021-09-08 22:07:19 +10:00
Deon George
01d54794a8 Rename PacketProcess, fix Packet::open now using Zone not Domain 2021-08-30 00:24:40 +10:00
Deon George
9fb6d191d0 Change the way we figure out zones in packets, some packet testing, fix Echomail import 2021-08-29 23:58:12 +10:00
Deon George
85d9dd1545 Catch Exception when interpretting date, Create MSGID if it doesnt exist, Fix when \r\n is used in messages. 2021-08-27 23:24:31 +10:00
Deon George
403dde0d35 Fix seenby/path addresses, fix when eom signature is split over the readbuf 2021-08-26 22:01:16 +10:00
Deon George
b614779290 Only queue messages if the packet has too many 2021-08-25 22:32:15 +10:00
Deon George
5e3b59ea7c Add subject to encoding, some packet fixes missed in previous commit 2021-08-25 00:15:09 +10:00
Deon George
d86d90cdeb Leverage Redis and queue to handle large packets 2021-08-24 23:42:03 +10:00
Deon George
1398ecff2d
Fix seenaddress accessed before initialisation 2021-08-23 13:35:47 +10:00
Deon George
1ae73e80c2 When MSGID has domain but no point 2021-08-22 16:55:39 +10:00
Deon George
071b817194 Fix processing msgid with @domain 2021-08-22 16:45:09 +10:00
Deon George
cab402d146 Fix MSGID parsing when it has more than the FTN address 2021-08-22 11:00:41 +10:00
Deon George
68a10af776 Change how our src is determined in packets, add hexdump to packet debug 2021-08-21 00:33:41 +10:00
Deon George
9f762a642c Added SEEN-BY/PATH processing, dont show networks that are not public, minor other formatting 2021-08-19 23:35:48 +10:00
Deon George
8685c6407a
Fix ping blank messages 2021-08-19 16:59:12 +10:00
Deon George
bcf3297fdb Check for duplicate echomails, validate system password 2021-08-19 00:20:34 +10:00
Deon George
6af466605a Logging updates 2021-08-18 22:11:16 +10:00
Deon George
259ea01fd1 Layout changes by responses, fix NodeHeirarchy domains nolonger have default 2021-08-18 00:03:44 +10:00
Deon George
978843b5e3 Simplified logging and fix BINKP issue when receiving less than the blksize 2021-08-17 23:49:39 +10:00
Deon George
5bf612e5b4 Set packed boolean when packing Netmail's is successful 2021-08-16 22:30:34 +10:00
Deon George
111461e515 Logging updates, some function optimisation 2021-08-16 00:41:43 +10:00
Deon George
b8478adecb Catch Netmails that dont generate an exception when converting to a packed message. Make sure we present unique addresses 2021-08-15 19:47:33 +10:00
Deon George
414a10f84e Fix end session report, move address when system is a ZC, show #addresses on systems 2021-08-15 11:42:38 +10:00
Deon George
4048289cf3 Implemented hide AKA, Minor Node::class changes, other fixes 2021-08-14 16:14:43 +10:00
Deon George
6c6976678f Change joins with a collection to use collection joins 2021-08-14 11:23:04 +10:00
Deon George
385290d18c Handle packets with errors differently 2021-08-13 23:46:48 +10:00