Commit Graph

357 Commits

Author SHA1 Message Date
096e37ef35 Removed packet cache, it wasnt used and not needed since we can queue large packets. Renamed to for consistent variable when using Packet::process() 2023-09-15 08:14:27 +10:00
ff8c370d86 Move packet processing into a job 2023-09-13 20:58:22 +10:00
dc86d09894 Fix file receiving mtime being set 2023-09-13 15:54:53 +10:00
6fb31e2632 Logging to catch the mtime being set on received files 2023-09-13 14:57:36 +10:00
e07369c7a1 Debugging to determine why we create Discovered System 2023-09-12 21:21:09 +10:00
99866458a4 Limit where were respond to test messages 2023-09-12 17:46:32 +10:00
ab7f661800 Use FTN from origin as our primary address, and msgid if the origin line doesnt have one 2023-09-11 21:52:48 +10:00
673c444acd Implement 2D domain processing - mainly for fidonet 2023-09-10 22:48:12 +10:00
67c1be209d Logging changes when processing TIC files 2023-09-09 00:10:45 +10:00
7b39dafd12 Change verbosity of TCP read/sent to debug 2023-09-08 21:04:24 +10:00
ed43aaa878 Fix for DNS query's using the domain's dnsdomain 2023-09-08 21:04:24 +10:00
485d67b366 Enable binkp non-secure mode 2023-09-08 21:04:24 +10:00
005aa88514 Fix for App\Classes\File\Tic::close must be compatible with parent 2023-09-08 21:04:24 +10:00
6498e364fb More TIC processing fixes 2023-09-08 21:04:24 +10:00
63a9c06fb0 Fix for bug introduced in previous commit, where tic files where queued without the address prefix 2023-09-07 12:25:44 +10:00
1e17aed170 Debugging to try and catch address creation exception (because of two active addresses) 2023-09-04 14:15:53 +12:00
61582fa4da Fix for when we have a duplicate FTN and we are logging that - Attempt to read property ftn on string 2023-09-04 12:11:20 +12:00
5a62d69913 When reading from remote with a timeout, return NULL if nothing received 2023-08-10 11:11:47 +10:00
74a56d1e17 Now correctly showing packet receive time, and sending Notifications based on the packet address, not the node address 2023-08-06 13:43:10 +10:00
c8a2affbfa Fix for when packets have a kludge after the origin line, and now capturing taglines. Updated testing configuration 2023-08-05 15:19:10 +10:00
944ae41fba Record some todo's 2023-07-29 13:17:59 +10:00
f1ccca25ea Change public to show on echo/file areas to enable limiting whats shown in the activity graph 2023-07-28 13:22:39 +10:00
4e44e2e266 Added system polling 2023-07-26 19:44:07 +10:00
c23b5ebfc2 Minor changes to thin font 2023-07-25 23:14:33 +10:00
17fe7e910d Multiple enhancements to interactive messages, moved messages to Notifications, send netmail back when invalid packet password 2023-07-23 20:21:02 +10:00
9f0fa0a8ec Fix Page::class and rendering 2023-07-23 18:44:39 +10:00
02a3963a12 Fix netmail flags for netmails originating here 2023-07-20 23:12:26 +10:00
8d9bde9692 Fix messages to points, and fix netmail coming from systems which dont include an Origin line 2023-07-20 22:16:38 +10:00
e1169335be Fix for when NR mode is active 2023-07-19 16:38:41 +10:00
f9a74578ff Fix for large packet transfer, since we were evaluating with the wrong size 2023-07-19 16:24:35 +10:00
f4fc6c24a4 Move the send DB updates out of the protocol and into Send::class 2023-07-19 12:32:41 +10:00
7584e3e44e Fix for received bytes, when packets have been processed 2023-07-19 10:49:57 +10:00
dcae06aad9 Change DEBUG to a static const 2023-07-19 10:27:47 +10:00
ee03604de3 Fixes to EMSI/ZModem as a result of previous enhancements to items 2023-07-18 23:00:13 +10:00
c1ec4eff36 Optimised our sending and receiving of items 2023-07-18 23:00:13 +10:00
a3302b4012 Complete of logging received and sent packet names, and display them in the web ui for each node 2023-07-15 22:10:05 +10:00
61ab0614b6 Correctly storing netmail flags (intransit, local, recv) with senders ID and packet name 2023-07-15 10:46:19 +10:00
7bf957df3a Sending Mail now dynamically creates packet name, size and mtime 2023-07-14 20:03:09 +10:00
28101237e8 Fixes for CRYPT, NOREL and MULTIBATCH when responding in server mode 2023-07-12 23:34:01 +10:00
b37c6407fb Fix for incorrectly batching up more mail after EOB, if MULTIBATCH is not agreed 2023-07-11 21:34:47 +10:00
5516b5dc23 Fixes for BINKP, we were sending too many EOB's 2023-07-11 17:22:31 +10:00
029ec9c209 Only consider NR mode if the offset presented is -1 2023-07-09 22:19:11 +10:00
d4439a6b58 Dont send an M_GET when we are not in NR mode, or we are offered a file from a zero offset. 2023-07-09 11:18:57 +10:00
faeec61aeb Fix for limiting AKAs, show parent PID that forked child, other minor fixes 2023-07-08 18:00:23 +10:00
02105b10fb Fix EMSI sessions, buffer_clear() was renamed tx_purge() 2023-07-08 17:36:41 +10:00
ccdce6bb62 Move mailer details into a separate table 2023-07-07 23:59:04 +10:00
ad4ea699a5 Fix BINKP transfers when tcp buffer has more chars than we need at that point in time 2023-07-07 23:13:43 +10:00
30c11956dd Remove some debugging left from previous commits, fix Address::scopeTrashed(), change display of BBS list 2023-07-07 22:42:02 +10:00
36d03d1c12 Fix for region_id when importing messages and the address exists in a different region 2023-07-06 13:55:54 +10:00
d6aafa4322 Changes to phone, add Active/Archive to echomail list for nets 2023-07-06 11:55:54 +10:00
0f7a42c503 Enabled configuration of EMSI tunables in setup 2023-07-06 09:20:33 +10:00
c3d4c1fc31 Enable full setup on the setup form 2023-07-05 22:58:24 +10:00
6f298d778f Some BINKP optimisation, implemented crypt, implemented receiving compressed transfers 2023-07-05 19:38:50 +10:00
f9f9fb5345 Improve debugging and code optimisations for Socket operations 2023-07-04 11:33:28 +10:00
ad36da0bb1 Code cleanup, no functional changes 2023-07-04 11:33:28 +10:00
75549590fc Enable systems to configure their packet type 2023-06-26 21:24:24 +12:00
a26f61d75d Define and detect different packet types (2,2e,2+,2.2) 2023-06-26 21:24:24 +12:00
b8534d8598 Make filename unique for each area, rename column to name/lname for files 2023-06-23 17:33:47 +10:00
b1b86ca04a Implemented file sending during BINKP and EMSI sessions 2023-06-22 22:13:47 +10:00
58341db0fb Show netmails to admins, record netmail path in the DB 2023-06-18 23:33:26 +10:00
e3f2d6cf15 Fix EMSI TRX time - force it to be local time 2023-06-17 11:37:59 +10:00
b41d65a8fd Fix SocketClient checking for more data, now that we buffer received data 2023-06-16 23:18:35 +10:00
ccf01a1b23 Enhancements to DNS server and notes for usage with bind 2023-06-12 23:19:50 +10:00
b1c62ae227 Update SocketClient to support UDP. Change DNS queries to use SocketClient 2023-06-11 22:18:52 +10:00
b1d522d8cc Added DNS server 2023-04-22 21:30:30 +10:00
Deon George
51e915b73d Fix for EMSI timezone and add MOH# 2023-02-12 13:30:07 +11:00
Deon George
d949737608 Fix authentication for originating EMSI session with known systems 2023-02-11 23:06:13 +11:00
Deon George
3dc18a3f1f Change default internal caching to off, and added test to make sure things are cached if on. More debugging with packet name for netmails 2023-01-25 16:26:10 +11:00
Deon George
63e3397aee Add packet name for incoming netmails, dont send back messages to sender for areafix messages 2023-01-24 23:16:11 +11:00
Deon George
bc19f9aa82 Increase logging on the type of file if it isnt a mail packet 2023-01-24 22:03:17 +11:00
Deon George
d9b575b38f Change our determination that a packet has been processed before deciding to delete it 2023-01-24 22:03:17 +11:00
Deon George
dac880b689 Ignore case when checking if a file is a PKT file 2023-01-24 22:03:17 +11:00
Deon George
3392092131 Some comments for binkd 2023-01-11 14:36:40 +11:00
Deon George
724bc4c5af Dont abort on an SQL exception 2023-01-11 14:36:40 +11:00
Deon George
4016775b66 Improved display of bad packets 2023-01-11 14:36:40 +11:00
Deon George
109beb4f4f Enable processing messages coming from a domain with multiple zones 2023-01-02 23:31:31 +11:00
Deon George
c1ab14f2e6 Fix echoarea display with the oldest message 2023-01-01 14:33:52 +11:00
Deon George
6c97eb2d81 Fix for when TZUTC is gibberish, and use file hexdump in pkt debug 2023-01-01 12:02:28 +11:00
Deon George
0e7b93abd1 Fix to make sure we resend the EMSI_REQ banner 2022-12-31 15:13:17 +11:00
Deon George
f089f3bcdc Dont delete archive until all packets processed 2022-12-04 21:59:06 +11:00
Deon George
4d3d57fdcd Fix EMSI session undefined, other minor cosmetic code changes 2022-12-04 20:45:33 +11:00
Deon George
05528f1c33 More work on user linking to existing defined system 2022-12-04 13:30:38 +11:00
Deon George
14f28c5263 Fix packet parsing for unknown zones, or zones that are not default 2022-12-03 16:00:38 +11:00
Deon George
a897852072 Fix binkp M_nul OPT parsing 2022-12-03 15:30:31 +11:00
Deon George
09fe65a8db EMSI Continue sending mail until no more mail to send 2022-12-03 01:25:44 +11:00
Deon George
e78b5975b0 Reduce zmodem debugging 2022-12-03 01:25:44 +11:00
Deon George
170f5c87ed Log systems polling 2022-12-03 01:25:44 +11:00
Deon George
d5d4a0d781 Auto create Domains/Zones as systems present their AKAs to us 2022-12-03 01:25:44 +11:00
Deon George
216bd1a2cd Sometimes guessExtension doesnt return bin for pkt's 2022-11-15 22:13:31 +11:00
Deon George
4e66990826 Fix processing packets when we loop without reading 2022-11-15 22:01:05 +11:00
Deon George
3ffb1c1fd6 Support for ZIP archives 2022-11-14 00:29:55 +11:00
Deon George
e7ebaa85cb Fix nodelist crc's that have 8 chars 2022-11-13 15:17:22 +11:00
Deon George
eab36c1603 Create TO ftn (for netmails), identify REPLYID, add file:list 2022-11-11 22:57:40 +11:00
Deon George
6284016400 Auto create FTN address for intransit netmail when the destination is not known. 2022-11-06 14:40:03 +11:00
Deon George
9a8ee1aa2b Fix packets with null values in the date, and exceptions not catching it 2022-11-05 19:17:37 +11:00
Deon George
c7187dbb0e Fix casting on compressed attributes when value is NULL, reduce some BINKP debugging messages 2022-11-05 15:17:11 +11:00
Deon George
9721db185b Ensure Echomail is initialised correctly 2022-11-05 10:17:14 +11:00
Deon George
34f289953d Implementation fixes for TIC processing 2022-11-05 10:17:14 +11:00
Deon George
7571a2cd7d Enable moving inbound files to s3 and logging in DB 2022-11-04 17:30:18 +11:00
Deon George
029a8a9d73 Added file areas and TIC processing 2022-11-02 22:01:45 +11:00
Deon George
0fe65d6187 Change gethostbyname() with dns_get_record() 2022-03-25 21:50:58 +11:00
Deon George
8072f7c5a9 Work on registration of existing systems to users 2022-03-20 22:42:11 +11:00
Deon George
6db16712ee Fix passthrough netmail. 2022-02-19 17:03:12 +11:00
Deon George
daba4a78d3 Fix echoarea name is converted to UC, add netmail VIA lines for outgoing netmail 2022-02-17 23:55:37 +11:00
Deon George
f216f42917 Minor cosmetic changes, show hex_dump when data purged from protocol stream 2022-02-13 11:27:23 +11:00
Deon George
f142284a2b Understand some gated messages, that are gated from a different zone 2022-02-12 11:35:24 +11:00
Deon George
d1bfa3a035 Fix for trying to receive a new file, when the previous file open failed with a permission denied 2022-02-06 20:40:21 +11:00
Deon George
a05ca1c2a4 Misc bug fixes while testing 2022-02-06 20:40:21 +11:00
Deon George
b65289af9f Enable binding ports for IPv6 2022-02-03 13:23:58 +11:00
Deon George
d660d5a6df Move DomainController::NODE* to Address::NODE*, make role mandatory in the database, change logic so that mail generated by the host comes from a node address. 2022-02-03 13:23:58 +11:00
Deon George
efa7195633 Add DBID back to messages, add path/seen-by to generated messages, other minor cosmetic fixes 2022-01-22 23:08:46 +11:00
Deon George
fe9fbb88b0 Fix packet name sent to remote - now matches packet name stored in DB 2022-01-20 23:25:47 +11:00
Deon George
98c9b880d4 Some debugging to track packet names created for sending 2022-01-20 22:47:44 +11:00
Deon George
421cd565bd Enable us to create an outbound packet without updating send details. Determine the send address for packets earlier 2022-01-20 17:54:02 +11:00
Deon George
c7e6bb2575 Enable system mail hold 2022-01-16 11:51:49 +11:00
Deon George
6f1d47a6ab Fixes to message processing, now that we are using cockroachdb 2022-01-15 17:11:51 +11:00
Deon George
424d6ef39d Switchout DB to CockroachDB 2022-01-15 14:58:41 +11:00
Deon George
fa2ac9a656 Changes to Authorisation for users to edit systems, minor cosmetic fixes and more logging 2021-12-29 13:44:27 +11:00
Deon George
bf57f151d5 Attempt to catch invalid FTN addresses while parsing packets 2021-12-01 23:41:20 +11:00
Deon George
3a1c6d55c6 Enable UTF8 encoding to/from as well in messages 2021-12-01 22:45:51 +11:00
Deon George
f1780e61ea Some messages have the origin in the middle of the message - change strpos to strrpos 2021-11-29 21:12:44 +11:00
Deon George
a00534794e Another fix for when packets contain binary messages with SOH chars. 2021-11-29 00:12:37 +11:00
Deon George
880ff81eff Fix for when packets contain binary messages with SOH chars. Added testing for packet parsing 2021-11-28 22:41:07 +11:00
Deon George
b35655a163 Page rendering using ANSI support 2021-11-27 00:40:12 +11:00
Deon George
871430edf8 Replace path from duplicate messages when the existing path is blank 2021-11-25 21:22:36 +11:00
Deon George
ebd1cf8732 Enable duplicates to update seen-by's before being discarded 2021-11-24 22:34:40 +11:00
Deon George
02c23f047c Fix for recording seen-by, add md5 to message body, fix incorrect log of dispatching messages 2021-11-21 16:53:56 +11:00
Deon George
8c127ba5da
Try not abort on exception when we cannot dispatch a message to be processed 2021-10-26 17:51:17 +11:00
Deon George
cabf9bca8b Fix for corrupt packets and the object is not properly initialised 2021-10-25 21:09:57 +11:00
Deon George
b246f0051f Fix polling, presenting our address. Fix logging address. 2021-10-18 23:08:08 +11:00
Deon George
83e06908b0 Multiple exception bug fixes identified during testing 2021-10-07 23:32:37 +11:00
Deon George
fa97fbb0c1 Fix responding to echomail from points 2021-10-02 10:03:17 +10:00
Deon George
eda0926758 Added converting ANSI to a binary format, and custom font rendering 2021-10-02 10:03:17 +10:00
Deon George
82e3283d6d Move address polling to a Job, better catch Socket connection refused errors 2021-09-20 20:39:03 +10:00
Deon George
8b8b513ed1 Add kludge to Test responses 2021-09-14 23:14:13 +10:00
Deon George
2cd6db2060 Dont launch bot processing for rescanned messages 2021-09-13 23:02:39 +10:00
Deon George
79e613a811 Allow for origin/tagline/tearline can have UTF8 chars, show # messages in packets 2021-09-12 23:06:17 +10:00
Deon George
5e8b590f17 Move process functions to Netmail/Echomail folders, optimize Netmail creation when processing messages 2021-09-12 22:14:04 +10:00
Deon George
f91778b515 Fix for when msgid address is from an unknown zone 2021-09-12 22:09:45 +10:00
Deon George
fcdde10512 Auto create nodes that are discovered by message packets 2021-09-11 23:32:10 +10:00
Deon George
7e176d7bc1 Fix for unknown FTN when connection is not established, try and catch unknown socket exception during session initialisation 2021-09-11 11:47:26 +10:00
Deon George
e8a9508391 Ping/Test send/recevied time was switched 2021-09-10 22:27:00 +10:00
Deon George
fbfa2d5183 Fix Cannot assign null to property when tagline/tearline are blank during export 2021-09-08 22:53:27 +10:00
Deon George
03c4b87cdd Fix packet password on exports, move __unserialize() to EncodeUTF8::decode 2021-09-08 22:07:19 +10:00
Deon George
dbbfe46cb9 Echomail export 2021-09-08 22:07:19 +10:00
Deon George
01d54794a8 Rename PacketProcess, fix Packet::open now using Zone not Domain 2021-08-30 00:24:40 +10:00
Deon George
9fb6d191d0 Change the way we figure out zones in packets, some packet testing, fix Echomail import 2021-08-29 23:58:12 +10:00
Deon George
85d9dd1545 Catch Exception when interpretting date, Create MSGID if it doesnt exist, Fix when \r\n is used in messages. 2021-08-27 23:24:31 +10:00
Deon George
403dde0d35 Fix seenby/path addresses, fix when eom signature is split over the readbuf 2021-08-26 22:01:16 +10:00
Deon George
b614779290 Only queue messages if the packet has too many 2021-08-25 22:32:15 +10:00
Deon George
5e3b59ea7c Add subject to encoding, some packet fixes missed in previous commit 2021-08-25 00:15:09 +10:00
Deon George
d86d90cdeb Leverage Redis and queue to handle large packets 2021-08-24 23:42:03 +10:00
Deon George
1398ecff2d
Fix seenaddress accessed before initialisation 2021-08-23 13:35:47 +10:00
Deon George
1ae73e80c2 When MSGID has domain but no point 2021-08-22 16:55:39 +10:00
Deon George
071b817194 Fix processing msgid with @domain 2021-08-22 16:45:09 +10:00
Deon George
cab402d146 Fix MSGID parsing when it has more than the FTN address 2021-08-22 11:00:41 +10:00
Deon George
68a10af776 Change how our src is determined in packets, add hexdump to packet debug 2021-08-21 00:33:41 +10:00
Deon George
9f762a642c Added SEEN-BY/PATH processing, dont show networks that are not public, minor other formatting 2021-08-19 23:35:48 +10:00
Deon George
8685c6407a
Fix ping blank messages 2021-08-19 16:59:12 +10:00
Deon George
bcf3297fdb Check for duplicate echomails, validate system password 2021-08-19 00:20:34 +10:00
Deon George
6af466605a Logging updates 2021-08-18 22:11:16 +10:00
Deon George
259ea01fd1 Layout changes by responses, fix NodeHeirarchy domains nolonger have default 2021-08-18 00:03:44 +10:00
Deon George
978843b5e3 Simplified logging and fix BINKP issue when receiving less than the blksize 2021-08-17 23:49:39 +10:00
Deon George
5bf612e5b4 Set packed boolean when packing Netmail's is successful 2021-08-16 22:30:34 +10:00
Deon George
111461e515 Logging updates, some function optimisation 2021-08-16 00:41:43 +10:00
Deon George
b8478adecb Catch Netmails that dont generate an exception when converting to a packed message. Make sure we present unique addresses 2021-08-15 19:47:33 +10:00
Deon George
414a10f84e Fix end session report, move address when system is a ZC, show #addresses on systems 2021-08-15 11:42:38 +10:00
Deon George
4048289cf3 Implemented hide AKA, Minor Node::class changes, other fixes 2021-08-14 16:14:43 +10:00
Deon George
6c6976678f Change joins with a collection to use collection joins 2021-08-14 11:23:04 +10:00
Deon George
385290d18c Handle packets with errors differently 2021-08-13 23:46:48 +10:00
Deon George
393600f96f Dont process incomplete files 2021-08-12 21:59:48 +10:00
Deon George
eb0405f019 Added echoareas and fileareas 2021-08-11 23:45:49 +10:00
Deon George
7ec01d778a System::match() now returns an array 2021-08-08 23:53:56 +10:00
Deon George
7922bc6a7a Fix errors must not be accessed before initialization 2021-08-08 22:49:38 +10:00
Deon George
b179b1b3e9 Mail routing parent/children, domain name validation, nodelist import changes and other fixes 2021-08-08 01:14:11 +10:00
Deon George
d937547599 Some message optimisation, added Echomail processing 2021-07-31 00:44:23 +10:00
Deon George
bbbb06d0a2 Framework update and minor packet debug cosmetics 2021-07-24 00:54:39 +10:00
Deon George
ee30ef92c3 New algorithm for calculating packet name, EMSI/BINKP inbound processing tested, Netmail rejection and intransit processing 2021-07-24 00:53:35 +10:00
Deon George
2fdc6eabad Revise CRC calls and use php's internal functions 2021-07-21 20:52:17 +10:00
Deon George
7cd3b814bb Remove processed packets if there were no issues 2021-07-20 00:26:12 +10:00
Deon George
6027ce52ab Fix child processes exiting 2021-07-20 00:23:41 +10:00
Deon George
ccab973b4a Add missing ls_recvdata16 to ZMODEM 2021-07-19 22:15:09 +10:00
Deon George
5ad342fd56 EMSI now responding to PINGs in the same session 2021-07-18 23:37:44 +10:00
Deon George
9dcfe6b17d BINKP responding to incoming netmail pings 2021-07-18 22:11:34 +10:00
Deon George
bd85f8b055 Remove redundant tables and code 2021-07-17 20:28:25 +10:00
Deon George
066154f310 Minor debug packet cosmetic changes, Remove database/ items in docker build, Node address validation changes 2021-07-17 17:15:40 +10:00
Deon George
1fa566b26c Transfering netmail via EMSI 2021-07-17 17:15:40 +10:00
Deon George
a0d3c8d8ab Start of processing packets - implemented PING Responce to Netmail 2021-07-16 16:39:02 +10:00
Deon George
fe2784f98f Improvements for host selection, store ftn message in utf8 2021-07-16 16:37:18 +10:00
Deon George
5c5df12816 Display CP437 characters when debugging packets 2021-07-05 21:31:04 +10:00
Deon George
c8447d8573 Update and display last seen for systems 2021-07-04 23:24:38 +10:00
Deon George
acfde97e79 Fix binkp remote closing connection, add/delete session details, menu item this system, minor CSS fixes, move system form editing to individual files 2021-07-04 21:48:05 +10:00
Deon George
d56681a187 Rename BINKD to BINKP 2021-07-02 23:44:20 +10:00
Deon George
88d189110d Fix Address::parseFTN when matching addresses with 0's, minor cosmetic fixes, test subjects < 72 chars 2021-07-01 21:56:55 +10:00
Deon George
7356bedfa2 Packet header fixes, correctly identify packets from/to points 2021-06-29 23:23:59 +10:00
Deon George
987b4040fb Added packet debug on web UI 2021-06-29 20:45:57 +10:00
Deon George
17a44a0945 DB query performance fixes 2021-06-25 23:39:32 +10:00
Deon George
d1ca78d372 Changed to using new Address Model, Implemented Setup, Some minor CSS changes 2021-06-24 20:16:37 +10:00
Deon George
f9310566a0 Created server:start, turned down BINKP debugging, some Socket tweaks 2021-06-16 22:26:08 +10:00
Deon George
2cae5d984c Add email template 2021-06-13 23:01:21 +10:00