Commit Graph

792 Commits

Author SHA1 Message Date
Deon George
12a40a79fb Fix for single encoding error, when only the first message was decoded, some logging for Address objects 2022-02-13 11:27:23 +11:00
Deon George
f216f42917 Minor cosmetic changes, show hex_dump when data purged from protocol stream 2022-02-13 11:27:23 +11:00
Deon George
f142284a2b Understand some gated messages, that are gated from a different zone 2022-02-12 11:35:24 +11:00
Deon George
d1bfa3a035 Fix for trying to receive a new file, when the previous file open failed with a permission denied 2022-02-06 20:40:21 +11:00
Deon George
a05ca1c2a4 Misc bug fixes while testing 2022-02-06 20:40:21 +11:00
Deon George
b65289af9f Enable binding ports for IPv6 2022-02-03 13:23:58 +11:00
Deon George
d660d5a6df Move DomainController::NODE* to Address::NODE*, make role mandatory in the database, change logic so that mail generated by the host comes from a node address. 2022-02-03 13:23:58 +11:00
Deon George
efa7195633 Add DBID back to messages, add path/seen-by to generated messages, other minor cosmetic fixes 2022-01-22 23:08:46 +11:00
Deon George
fe9fbb88b0 Fix packet name sent to remote - now matches packet name stored in DB 2022-01-20 23:25:47 +11:00
Deon George
98c9b880d4 Some debugging to track packet names created for sending 2022-01-20 22:47:44 +11:00
Deon George
421cd565bd Enable us to create an outbound packet without updating send details. Determine the send address for packets earlier 2022-01-20 17:54:02 +11:00
Deon George
d930c410dc Remove caching on Zone, fix cockroach cannot do like on integers 2022-01-20 17:51:40 +11:00
Deon George
c7e6bb2575 Enable system mail hold 2022-01-16 11:51:49 +11:00
Deon George
6f1d47a6ab Fixes to message processing, now that we are using cockroachdb 2022-01-15 17:11:51 +11:00
Deon George
e78e79a8f5 Change sorting on graphs so that date is in date order 2022-01-15 14:58:42 +11:00
Deon George
6b0bf32552 Query optimisations for last_messages and traffic 2022-01-15 14:58:42 +11:00
Deon George
3d6f233c1d Added no_export option to stop a message from being exported when saved. 2022-01-15 14:58:42 +11:00
Deon George
847869911f Enable echomail subscription by any of a systems address 2022-01-15 14:58:42 +11:00
Deon George
424d6ef39d Switchout DB to CockroachDB 2022-01-15 14:58:41 +11:00
Deon George
afaa7d8bc7 Internal enhancements to system registration and editing 2022-01-05 09:26:42 +11:00
Deon George
fa2ac9a656 Changes to Authorisation for users to edit systems, minor cosmetic fixes and more logging 2021-12-29 13:44:27 +11:00
Deon George
10afd6f3a4
Limit graphic stats to 6 months by default, some performance query improvements 2021-12-03 11:24:23 +11:00
Deon George
bf57f151d5 Attempt to catch invalid FTN addresses while parsing packets 2021-12-01 23:41:20 +11:00
Deon George
3a1c6d55c6 Enable UTF8 encoding to/from as well in messages 2021-12-01 22:45:51 +11:00
Deon George
f1780e61ea Some messages have the origin in the middle of the message - change strpos to strrpos 2021-11-29 21:12:44 +11:00
Deon George
a00534794e Another fix for when packets contain binary messages with SOH chars. 2021-11-29 00:12:37 +11:00
Deon George
880ff81eff Fix for when packets contain binary messages with SOH chars. Added testing for packet parsing 2021-11-28 22:41:07 +11:00
Deon George
e0239d95a8 Enabled netmail test message 2021-11-27 00:41:09 +11:00
Deon George
b35655a163 Page rendering using ANSI support 2021-11-27 00:40:12 +11:00
Deon George
41d36fe86d
User dashboard caching 2021-11-26 17:19:55 +11:00
Deon George
6acc8ee407
Cache some calls to Mongo for performance 2021-11-26 16:58:50 +11:00
Deon George
be886d9e4b
Add query cache, show per echo stats on network page 2021-11-26 16:16:33 +11:00
Deon George
871430edf8 Replace path from duplicate messages when the existing path is blank 2021-11-25 21:22:36 +11:00
Deon George
ebd1cf8732 Enable duplicates to update seen-by's before being discarded 2021-11-24 22:34:40 +11:00
Deon George
02c23f047c Fix for recording seen-by, add md5 to message body, fix incorrect log of dispatching messages 2021-11-21 16:53:56 +11:00
Deon George
b333d38095 Added in network graph on about screen 2021-11-20 18:00:40 +11:00
Deon George
6f9df005aa Fixes to finding a record when FTN when region_id/host_id have the same value 2021-11-20 11:51:00 +11:00
Deon George
483e35202b Fix for addresses where region_id is set inlieu of host_id, sort system ZC addresses 2021-11-20 11:11:38 +11:00
Deon George
28cdedb327 Centralise dependant js/css files 2021-11-13 17:00:08 +11:00
Deon George
3c8895a238 User register system, minor cosmetic changes, start of user authorisation 2021-11-11 23:04:08 +11:00
Deon George
a0db589dc5 Start on user dashboard 2021-10-26 23:19:55 +11:00
Deon George
8c127ba5da
Try not abort on exception when we cannot dispatch a message to be processed 2021-10-26 17:51:17 +11:00
Deon George
cabf9bca8b Fix for corrupt packets and the object is not properly initialised 2021-10-25 21:09:57 +11:00
Deon George
3adf7c73b6 Change select2 to 4.0.13 and fix autofocus. Other minor cosmetic fix 2021-10-19 22:38:52 +11:00
Deon George
30fd916646 Add user alias 2021-10-19 22:21:32 +11:00
Deon George
53a96a8dbd Change dupe checking as per FTS-0009.001 2021-10-18 23:10:15 +11:00
Deon George
b246f0051f Fix polling, presenting our address. Fix logging address. 2021-10-18 23:08:08 +11:00
Deon George
83e06908b0 Multiple exception bug fixes identified during testing 2021-10-07 23:32:37 +11:00
Deon George
d0d6990d39 Minor cosmetic changes 2021-10-02 10:03:17 +10:00
Deon George
2c406ba3e9 Add $user (authed user) to views 2021-10-02 10:03:17 +10:00
Deon George
ca666e456a Enable user switching 2021-10-02 10:03:17 +10:00
Deon George
fa97fbb0c1 Fix responding to echomail from points 2021-10-02 10:03:17 +10:00
Deon George
eda0926758 Added converting ANSI to a binary format, and custom font rendering 2021-10-02 10:03:17 +10:00
Deon George
82e3283d6d Move address polling to a Job, better catch Socket connection refused errors 2021-09-20 20:39:03 +10:00
Deon George
8b8b513ed1 Add kludge to Test responses 2021-09-14 23:14:13 +10:00
Deon George
2cd6db2060 Dont launch bot processing for rescanned messages 2021-09-13 23:02:39 +10:00
Deon George
79e613a811 Allow for origin/tagline/tearline can have UTF8 chars, show # messages in packets 2021-09-12 23:06:17 +10:00
Deon George
5e8b590f17 Move process functions to Netmail/Echomail folders, optimize Netmail creation when processing messages 2021-09-12 22:14:04 +10:00
Deon George
f91778b515 Fix for when msgid address is from an unknown zone 2021-09-12 22:09:45 +10:00
Deon George
9462e66a1c Some logging fixes 2021-09-12 00:07:02 +10:00
Deon George
fcdde10512 Auto create nodes that are discovered by message packets 2021-09-11 23:32:10 +10:00
Deon George
04e8a899d4 Also ignore nodelist lines that are blank 2021-09-11 19:26:11 +10:00
Deon George
ff2b246d31 For nodelist import, find based on mailer_address first 2021-09-11 18:00:39 +10:00
Deon George
7e176d7bc1 Fix for unknown FTN when connection is not established, try and catch unknown socket exception during session initialisation 2021-09-11 11:47:26 +10:00
Deon George
72bc9790d1 Add option to not process bots during import 2021-09-11 00:40:52 +10:00
Deon George
e8a9508391 Ping/Test send/recevied time was switched 2021-09-10 22:27:00 +10:00
Deon George
fbfa2d5183 Fix Cannot assign null to property when tagline/tearline are blank during export 2021-09-08 22:53:27 +10:00
Deon George
64a887212d Add missed UsePostgres Trait 2021-09-08 22:10:27 +10:00
Deon George
03c4b87cdd Fix packet password on exports, move __unserialize() to EncodeUTF8::decode 2021-09-08 22:07:19 +10:00
Deon George
dbbfe46cb9 Echomail export 2021-09-08 22:07:19 +10:00
Deon George
8306f4c3a3 Start of echomail subscribing 2021-09-06 23:39:48 +10:00
Deon George
97384ce3a0 Fix message path ordering 2021-08-30 00:44:20 +10:00
Deon George
01d54794a8 Rename PacketProcess, fix Packet::open now using Zone not Domain 2021-08-30 00:24:40 +10:00
Deon George
9fb6d191d0 Change the way we figure out zones in packets, some packet testing, fix Echomail import 2021-08-29 23:58:12 +10:00
Deon George
271f066667 Added echomail search and display 2021-08-29 11:48:27 +10:00
Deon George
12f9ee1960 Changed nodelist import processing since we have a DB contraint on mailer address and port 2021-08-28 13:36:42 +10:00
Deon George
6b8704b1cf Added Echoarea NA file import 2021-08-28 00:10:42 +10:00
Deon George
85d9dd1545 Catch Exception when interpretting date, Create MSGID if it doesnt exist, Fix when \r\n is used in messages. 2021-08-27 23:24:31 +10:00
Deon George
ba7f9c1c99 Subject contains UTF-8 codes sometimes 2021-08-26 23:46:49 +10:00
Deon George
403dde0d35 Fix seenby/path addresses, fix when eom signature is split over the readbuf 2021-08-26 22:01:16 +10:00
Deon George
b614779290 Only queue messages if the packet has too many 2021-08-25 22:32:15 +10:00
Deon George
5e3b59ea7c Add subject to encoding, some packet fixes missed in previous commit 2021-08-25 00:15:09 +10:00
Deon George
d86d90cdeb Leverage Redis and queue to handle large packets 2021-08-24 23:42:03 +10:00
Deon George
1398ecff2d
Fix seenaddress accessed before initialisation 2021-08-23 13:35:47 +10:00
Deon George
1ae73e80c2 When MSGID has domain but no point 2021-08-22 16:55:39 +10:00
Deon George
071b817194 Fix processing msgid with @domain 2021-08-22 16:45:09 +10:00
Deon George
e0269c9718 Fix processing packets with echomail messages from points 2021-08-22 16:45:02 +10:00
Deon George
cab402d146 Fix MSGID parsing when it has more than the FTN address 2021-08-22 11:00:41 +10:00
Deon George
8c992ad0f9 Enhance nodelist import 2021-08-22 00:20:22 +10:00
Deon George
68a10af776 Change how our src is determined in packets, add hexdump to packet debug 2021-08-21 00:33:41 +10:00
Deon George
9f762a642c Added SEEN-BY/PATH processing, dont show networks that are not public, minor other formatting 2021-08-19 23:35:48 +10:00
Deon George
ad21285a8c
Tagline/tearline presentation is handled in Message::class 2021-08-19 17:24:56 +10:00
Deon George
8685c6407a
Fix ping blank messages 2021-08-19 16:59:12 +10:00
Deon George
bcf3297fdb Check for duplicate echomails, validate system password 2021-08-19 00:20:34 +10:00
Deon George
6af466605a Logging updates 2021-08-18 22:11:16 +10:00
Deon George
259ea01fd1 Layout changes by responses, fix NodeHeirarchy domains nolonger have default 2021-08-18 00:03:44 +10:00
Deon George
978843b5e3 Simplified logging and fix BINKP issue when receiving less than the blksize 2021-08-17 23:49:39 +10:00
Deon George
5bf612e5b4 Set packed boolean when packing Netmail's is successful 2021-08-16 22:30:34 +10:00
Deon George
628293c741 Enable default zones for 4d systems 2021-08-16 22:26:33 +10:00
Deon George
111461e515 Logging updates, some function optimisation 2021-08-16 00:41:43 +10:00
Deon George
b8478adecb Catch Netmails that dont generate an exception when converting to a packed message. Make sure we present unique addresses 2021-08-15 19:47:33 +10:00
Deon George
0789ee9042 Fix assigning default when system has more than 1 AKA in different zones 2021-08-15 17:26:01 +10:00
Deon George
988d4dda52 Sort node's AKAs, fix Host selection for new addresses 2021-08-15 16:41:04 +10:00
Deon George
ae96ff9a24 Fix System ZC identification 2021-08-15 16:01:51 +10:00
Deon George
414a10f84e Fix end session report, move address when system is a ZC, show #addresses on systems 2021-08-15 11:42:38 +10:00
Deon George
b9abd17139 Dont process messages from robots 2021-08-15 00:21:04 +10:00
Deon George
3badb895b0 Filearea validation fixes 2021-08-14 23:52:39 +10:00
Deon George
c904f1f9e9 Fix echoarea naming regex 2021-08-14 23:05:11 +10:00
Deon George
4048289cf3 Implemented hide AKA, Minor Node::class changes, other fixes 2021-08-14 16:14:43 +10:00
Deon George
569201e972 Server start based on config 2021-08-14 16:14:43 +10:00
Deon George
6c6976678f Change joins with a collection to use collection joins 2021-08-14 11:23:04 +10:00
Deon George
385290d18c Handle packets with errors differently 2021-08-13 23:46:48 +10:00
Deon George
05f387aab7 Assigning session details to ZC makes it default route 2021-08-13 22:53:59 +10:00
Deon George
53ab8851fa Add packet info console command 2021-08-12 23:15:45 +10:00
Deon George
393600f96f Dont process incomplete files 2021-08-12 21:59:48 +10:00
Deon George
eb0405f019 Added echoareas and fileareas 2021-08-11 23:45:49 +10:00
Deon George
c7388c2db6 Enabled default routing 2021-08-09 23:35:22 +10:00
Deon George
7ec01d778a System::match() now returns an array 2021-08-08 23:53:56 +10:00
Deon George
7922bc6a7a Fix errors must not be accessed before initialization 2021-08-08 22:49:38 +10:00
Deon George
72fb8044f9 Fix for identifying children for netmail packets 2021-08-08 21:50:09 +10:00
Deon George
8d4ca2963d Enabled moving address, minor CSS fixes 2021-08-08 17:27:35 +10:00
Deon George
7cd7849241 Move packet debug view to top level 2021-08-08 12:01:10 +10:00
Deon George
b179b1b3e9 Mail routing parent/children, domain name validation, nodelist import changes and other fixes 2021-08-08 01:14:11 +10:00
Deon George
49bc946024 CSS changes, enable links to system edit on network list 2021-08-08 01:12:11 +10:00
Deon George
d937547599 Some message optimisation, added Echomail processing 2021-07-31 00:44:23 +10:00
Deon George
6f26bc4c71 Validation fix when creating a new host 2021-07-31 00:43:25 +10:00
Deon George
29a707831e CSS fixes, BS5 doesnt have ml/mr,pl/pr. Fix remember me. Style consistencies. Added Error 500 page. 2021-07-24 14:12:10 +10:00
Deon George
bbbb06d0a2 Framework update and minor packet debug cosmetics 2021-07-24 00:54:39 +10:00
Deon George
ee30ef92c3 New algorithm for calculating packet name, EMSI/BINKP inbound processing tested, Netmail rejection and intransit processing 2021-07-24 00:53:35 +10:00
Deon George
2fdc6eabad Revise CRC calls and use php's internal functions 2021-07-21 20:52:17 +10:00
Deon George
7cd3b814bb Remove processed packets if there were no issues 2021-07-20 00:26:12 +10:00
Deon George
6027ce52ab Fix child processes exiting 2021-07-20 00:23:41 +10:00
Deon George
ccab973b4a Add missing ls_recvdata16 to ZMODEM 2021-07-19 22:15:09 +10:00
Deon George
a37da4b099 Validation fix when creating a new host 2021-07-18 23:38:18 +10:00
Deon George
5ad342fd56 EMSI now responding to PINGs in the same session 2021-07-18 23:37:44 +10:00
Deon George
9dcfe6b17d BINKP responding to incoming netmail pings 2021-07-18 22:11:34 +10:00
Deon George
bd85f8b055 Remove redundant tables and code 2021-07-17 20:28:25 +10:00
Deon George
066154f310 Minor debug packet cosmetic changes, Remove database/ items in docker build, Node address validation changes 2021-07-17 17:15:40 +10:00
Deon George
1fa566b26c Transfering netmail via EMSI 2021-07-17 17:15:40 +10:00
Deon George
32888533c1 Testing needs to have the database seeded 2021-07-16 17:08:57 +10:00
Deon George
a0d3c8d8ab Start of processing packets - implemented PING Responce to Netmail 2021-07-16 16:39:02 +10:00
Deon George
fe2784f98f Improvements for host selection, store ftn message in utf8 2021-07-16 16:37:18 +10:00
Deon George
5c5df12816 Display CP437 characters when debugging packets 2021-07-05 21:31:04 +10:00
Deon George
c8447d8573 Update and display last seen for systems 2021-07-04 23:24:38 +10:00
Deon George
acfde97e79 Fix binkp remote closing connection, add/delete session details, menu item this system, minor CSS fixes, move system form editing to individual files 2021-07-04 21:48:05 +10:00
Deon George
d56681a187 Rename BINKD to BINKP 2021-07-02 23:44:20 +10:00
Deon George
64fd264427 Usability fixes 2021-07-02 23:44:20 +10:00
Deon George
4522f26bf3 Docker build improvement, fix findFTN(), fix address add for systems 2021-07-02 01:09:16 +10:00
Deon George
54bcdf4b13 Minor css fixes, delete/pause addresses, validation fixes for nodes with 0 in address 2021-07-02 00:26:00 +10:00
Deon George
88d189110d Fix Address::parseFTN when matching addresses with 0's, minor cosmetic fixes, test subjects < 72 chars 2021-07-01 21:56:55 +10:00
Deon George
16a1d8a440 Catch packet errors and display a nice error 2021-06-29 23:42:35 +10:00
Deon George
7356bedfa2 Packet header fixes, correctly identify packets from/to points 2021-06-29 23:23:59 +10:00
Deon George
987b4040fb Added packet debug on web UI 2021-06-29 20:45:57 +10:00
Deon George
9897c928d9 Added ZT to System, more ZT validation on zone 2021-06-27 01:15:36 +10:00
Deon George
dfc4e305f1 Added search 2021-06-27 00:41:29 +10:00
Deon George
945afbfe4b Only show 3D addresses where necessary 2021-06-26 11:48:55 +10:00
Deon George
980f57e808 Renamed import nodelist job, dont display address id's to unauthed users, removed debugging from importnodelist. 2021-06-26 10:55:02 +10:00
Deon George
aa06296963 Fixes for nodelist importing 2021-06-26 10:35:02 +10:00
Deon George
17a44a0945 DB query performance fixes 2021-06-25 23:39:32 +10:00
Deon George
64215ebcea Import nodelists 2021-06-25 22:21:19 +10:00
Deon George
1f04f8374e Address input fixes, region_id/host_id must not be null, address constraints changes 2021-06-25 21:33:24 +10:00
Deon George
e207e0a1d8 Show ZC/RC name instead of system name, tweak FTN sort order 2021-06-24 23:09:09 +10:00
Deon George
25f853cea4 Fix zone update with zt_id, added some ZeroTier network settings 2021-06-24 22:28:06 +10:00
Deon George
d1ca78d372 Changed to using new Address Model, Implemented Setup, Some minor CSS changes 2021-06-24 20:16:37 +10:00
Deon George
7cab4e288b Added laravel/passport, assign ftn addresses to nodes 2021-06-20 23:05:19 +10:00
Deon George
0db119ab74 Start to show more information on network homepage 2021-06-19 11:59:01 +10:00
Deon George
68dc704ca0 Logout in-active users and dont respond to resets or logins 2021-06-19 10:51:49 +10:00
Deon George
e45f366b76 User editing and creation by system admin 2021-06-19 10:51:49 +10:00
Deon George
416e79164e Added Zones, authorisation on edits, validation enhancements 2021-06-18 23:08:05 +10:00
Deon George
491d3d55c3 Added System, fixed something with Domain, added 403, start of some other items 2021-06-18 00:08:30 +10:00
Deon George
f9310566a0 Created server:start, turned down BINKP debugging, some Socket tweaks 2021-06-16 22:26:08 +10:00
Deon George
292040cef7 Create CI testing 2021-06-16 19:08:27 +10:00
Deon George
4011b2a82d Enabled Domain homepage 2021-06-14 21:33:18 +10:00
Deon George
a3b4214040 CSS updates, layout tweeks, domain editing/updating 2021-06-14 15:46:18 +10:00
Deon George
55fcfa2e4a Enabled password resets 2021-06-13 23:01:21 +10:00
Deon George
2cae5d984c Add email template 2021-06-13 23:01:21 +10:00
Deon George
182f877701 Enabled new login page 2021-06-13 23:01:21 +10:00
Deon George
d7f3ab4130 Initial Web UI inspired by int10h.org 2021-06-13 01:32:22 +10:00
Deon George
b94e39c7af Add Zmodem/BINKP/EMSI 2021-06-13 01:32:22 +10:00
Deon George
619cabb751 Framework updates, merges from other packages 2021-06-13 01:32:22 +10:00
Deon George
503b775c49 Initial setup command 2021-06-13 01:32:22 +10:00
Deon George
5e5d0d6c3d Web frontend work 2021-06-13 01:32:22 +10:00
Deon George
834ece2645 Added SocketServer and SocketClient 2021-06-13 01:31:32 +10:00
Deon George
4b960e92d5 Web layout 2021-06-13 01:31:32 +10:00
Deon George
bede0a5880 Minor DB rework, remove spaces in database/migration files 2021-06-13 01:31:32 +10:00
Deon George
df849c0cfd Just optimisations 2019-05-20 17:18:18 +10:00
Deon George
9317f78a3a Work with netmail creation 2019-05-11 11:17:56 +10:00
Deon George
188fd1a2cf Initial netmail import 2019-05-06 22:29:29 +10:00
Deon George
9ba790e72c Initial echomail import 2019-04-27 23:59:00 +10:00
Deon George
6515c91270 Nodelist import 2019-04-26 14:30:00 +10:00
Deon George
5753982a8d FTN Packet inspection 2019-03-03 16:29:35 +02:00
Deon George
cad523577e Clean Laravel 5.7 Install 2018-11-15 21:45:49 +11:00