2000-12-28 22:35 Joost van Baal * Makefile.am, README, lr-client.sh, all/etc/Makefile.am, all/etc/explanation, all/man/Makefile.am, all/script/lr_anonimize, all/script/lr_dlf2raw, all/script/lr_getbody, all/script/lr_log2mail, all/script/lr_processmail, all/script/lr_raw2report, all/script/lr_spool, dns/script/distribution-requesttypes, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/developer.txt, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, www/script/report_bytesperday, www/script/report_bytesperresult, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage, www/script/report_requestsperday: added script to build client tarball. added some documentation. fixed some minor bugs. 2000-12-28 16:57 Joost van Baal * all/etc/defaults, all/etc/explanation, all/script/lr_anonimize, all/script/lr_desyslog, all/script/lr_dlf2raw, all/script/lr_getbody, all/script/lr_inflate, all/script/lr_log2mail, all/script/lr_log2raw, all/script/lr_log2report, all/script/lr_processmail, all/script/lr_spool, all/script/lr_spoold, all/script/process_sendabort, dns/script/distribution-requesttypes, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/TODO, doc/overview.txt, email/etc/defaults, email/script/filter, email/script/filter_messages, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, www/script/report_bytesperday, www/script/report_bytesperresult, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage, www/script/report_requestsperday: /bin/sh scripts now run as sh -e, to catch uncommon errors. 2000-12-28 15:11 Joost van Baal * all/man/Makefile.am, all/man/lr_log2mail.pod, all/man/lr_log2report.pod, all/script/Makefile.am, all/script/lr_dlf2raw, all/script/lr_dlf2report, all/script/lr_log2raw, all/script/lr_log2report, all/script/lr_log2shreport, doc/developer.txt, doc/overview.txt: more appropriate names of scripts. adapted some docs 2000-12-28 14:51 Joost van Baal * all/script/Makefile.am, all/script/lr_log2report, all/script/lr_raw2report, all/script/querycalc-tidy, doc/TODO, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain: anon capable responder, implementation number 2: users no longer will receive a program they gotta run, but receive a raw report. receivers feed this to a script they get _once_. this is a cleaner way to implement the client. security-wise, it's better. added lr_raw2report, which invokes formatters on raw report. adapted email report scripts. other services yet todo. some other scripts to be adapted. 2000-12-24 12:49 Joost van Baal * configure.in, all/script/lr_anonimize, all/script/lr_log2mail, doc/TODO: fixed some minor bugs in anon-capable spooler. 2000-12-20 21:47 Joost van Baal * all/: man/Makefile.am, man/lr_log2mail.pod, man/lr_log2shreport.pod, man/lr_processmail.pod, man/lr_spool.pod, script/lr_getbody, script/lr_log2mail, script/lr_processmail: added some manpages. submitters to the responder now can do mutt -s 'anon bigsunosbox.somebigisp.com 20001201 - 20001231' \ -a /big/fat/sendmaillogfile.gz log@sendmail.logreport.org < /dev/null and will get a report back which could be processed on site, to de-anonimize it. adapted lr_getbody, lr_log2mail and lr_processmail to support this. not tested yet, though. 2000-12-20 12:38 Joost van Baal * all/man/Makefile.am, all/man/lr_log2report.pod, all/script/Makefile.am, all/script/lr_anonimize, all/script/lr_log2mail, all/script/lr_log2report, all/script/lr_log2shreport, all/script/querycalc-tidy, dns/script/distribution-requesttypes, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/overview.txt, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, www/script/report_bytesperday, www/script/report_bytesperresult, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage, www/script/report_requestsperday: querycalc tidy no longer uses Getopt. It should run on any box, for people using the now-being-implement anonized responder. 2000-12-20 11:12 Joost van Baal * all/man/Makefile.am, all/man/lr_log2mail.pod, all/script/Makefile.am, all/script/lr_log2mail, all/script/lr_log2report, all/script/lr_log2shreport, dns/script/distribution-requesttypes, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/overview.txt, www/script/report_bytesperresult, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage, www/script/report_requestsperday: www and dns report scripts now adhere to report-in-sh-format policy 2000-12-20 00:11 Joost van Baal * all/script/Makefile.am, all/script/lr_anonimize, all/script/lr_deanonimize, all/script/lr_dlf2report, doc/TODO, doc/developer.txt, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, www/script/report_bytesperday: de-anonimizer in alpha status. addapted reports: now they're fist produced in .sh format. these can be fed to the de-anonimizer. converting to human readable format is done be feeding to sh(1). dns and www report engine still to be adapted. engine next to log2report to be adapted. 2000-12-17 00:18 Joost van Baal * NEWS, doc/TODO: new tarball. 2000-12-16 23:20 Joost van Baal * Makefile.am, README, configure.in, all/lib/Dlf.pm, all/man/lr_log2report.pod, all/script/lr_dlf2report, all/script/lr_log2mail, all/script/lr_log2report, doc/developer.txt, email/etc/dlf.cfg, email/etc/dlf.default, email/script/filter, email/script/report_delay, email/script/report_error, email/script/report_size, include/rules.mk: more porting efforts: now solaris /usr/bin/awk resistant. some more export FOO=bar thingies cleaned up. 2000-12-16 21:09 Joost van Baal * all/script/lr_log2report, email/script/filter-messages, email/script/filter_messages: cvs housekeeping after sourceforge network move 2000-12-15 00:02 Joost van Baal * all/script/: desyslog, lr_dlf2report, lr_getbody, lr_log2mail, lr_processmail, lr_spool: shell scripts a bit more portable now. refer to ~vanbaal/doc/autoconf/autobook-1.0/writing20portable20bourne20shell .html 2000-12-14 19:47 Joost van Baal * Makefile.am, doc/TODO, doc/developer.txt: Makefile.am: now we can do `make dist' to build a tarball. 2000-12-13 22:40 Joost van Baal * README, configure.in, doc/developer.txt: made sendmail2dlf less chatty. added notes about configuration to README 2000-12-13 22:02 Joost van Baal * NEWS, README, all/etc/logreportrc, all/script/log2report, all/script/lr_dlf2report, doc/TODO, doc/adding_service.txt, doc/developer.txt, doc/fhs.txt, doc/roadmap.txt: some documentation clean up. 2000-12-13 21:19 Joost van Baal * NEWS, all/etc/defaults, all/man/lr_log2mail.pod, all/script/lr_log2mail, all/script/lr_smtpfield, doc/TODO, email/etc/Makefile.am, email/etc/defaults, email/etc/muttrc: no longer depends on mutt(1). we invoke sendmail(1) directly now. 2000-12-13 17:02 Joost van Baal * doc/TODO: postfix2dlf now less chatty about skipping lines 2000-12-13 16:32 Joost van Baal * INSTALL, NEWS, all/lib/Dlf.pm, all/script/Makefile.am, all/script/lr_anonimize, all/script/lr_log2mail, doc/TODO, doc/developer.txt, email/etc/dlf.default: made postfix and qmail convertors aware of new email dlf format 2000-12-13 10:47 Joost van Baal * INSTALL, README, THANKS, doc/TODO: postfix2dlf: applied Brad Knowles patch, to support nqmgr 2000-12-13 01:09 Joost van Baal * email/script/: filter, report_delay, report_error, report_size: ported awk scripts to the original Aho, Kernighan & Weinberger awk, as shipped with OpenBSD. 2000-12-13 00:37 Joost van Baal * README, all/script/lr_anonimize, doc/TODO, doc/fhs.txt, email/etc/dlf.cfg, email/lib/Email.pm, email/script/report_delay, email/script/report_error, email/script/report_fromrelay, email/script/report_perday, email/script/report_perhour, email/script/report_torelay: email 2dlf engines are supposed to generate both relayip and relayhostname. sendmail2dlf done. email reports rely on this. bugfixes for sendmail2dlf 2000-12-12 17:10 Joost van Baal * THANKS: thanks file 2000-12-12 16:50 Joost van Baal * ChangeLog, INSTALL, NEWS, README, doc/TODO, doc/developer.txt, email/script/report_perday, email/script/report_perhour: fixed bugs in sendmail2dlf, made email report_* scripts not depend on bash 2000-12-12 13:30 Joost van Baal * all/script/lr_anonimize: logfile anonimizer. de-anonmizer yet to be build 2000-12-11 17:09 Joost van Baal * README, doc/adding_service.txt, doc/developer.txt, doc/fhs.txt, doc/log.txt, doc/overview.txt, doc/roadmap.txt: updating docs. 2000-12-11 16:31 Joost van Baal * all/script/dlf_sum, email/lib/Email.pm: some extra checking on input before processing, to catch errors. 2000-12-10 13:07 Joost van Baal * INSTALL, README, email/lib/Email.pm: fixed bug which caused postfix2dlf to choke on (queue active) thingies, which occur after the size= field in some logs. 2000-12-10 02:14 Joost van Baal * doc/: developer.txt, fhs.txt: added notes on how to upload new website 2000-12-05 14:29 Joost van Baal * README, doc/TODO, doc/developer.txt, doc/fhs.txt: anonimized 2000-12-05 13:19 Joost van Baal * README, all/lib/Dlf.pm, all/script/lr_log2mail, doc/TODO, doc/fhs.txt: fixed deep perl bug in qmail2dlf, which showed up only in bigger logs. 2000-12-05 02:09 Joost van Baal * README, all/etc/profile_lean, all/script/lr_desyslog, all/script/lr_dlf2report, all/script/lr_getbody, all/script/lr_inflate, doc/fhs.txt, email/lib/Email.pm: fixed a lot of bugs in postfix2dlf: now can grok fields containing spaces, stores fields in lowercase, uses generic LogReport::Email library, does no longer store all interesting data in core before writing (so no longer a memory hog), generates xstat field, complains when skipping lines. 2000-12-03 23:54 Joost van Baal * README, all/script/lr_getbody, all/script/lr_inflate, all/script/lr_processmail, all/script/lr_spoold, doc/TODO, doc/developer.txt: code cleanup postfix2dlf. 2000-11-30 01:17 Joost van Baal * README, all/man/lr_dlf2report.pod, doc/INSTALL, doc/README, doc/TODO, doc/developer.txt, doc/fhs.txt, doc/overview.txt: documentation update 2000-11-30 00:30 Joost van Baal * README, all/man/Makefile.am, all/man/lr_dlf2report.pod, all/man/lr_log2mail.pod, all/script/Makefile.am, all/script/lr_dlf2report, all/script/lr_log2mail, doc/TODO, doc/overview.txt, email/etc/reportscripts_filter, email/etc/reportscripts_filter_messages, www/script/Makefile.am: now one can get a report from a logfile printed to stdout, next to getting it emailed. 2000-11-29 13:10 Joost van Baal * README, all/man/Makefile.am, all/man/lr_dlf2report.pod, all/script/Makefile.am, all/script/lr_dlf2report, all/script/lr_log2mail, all/script/lr_processmail, dns/script/Makefile.am, dns/script/report, doc/TODO, email/etc/Makefile.am, email/etc/defaults, email/etc/reportscripts_filter, email/etc/reportscripts_filter_messages, email/script/Makefile.am, email/script/report, email/script/report_perhour, www/script/report: merged superservice specific report scripts to one generic script. finally! i guess we can clean up our deep and complicated PATH now. 2000-11-29 10:40 Joost van Baal * README, configure.in, doc/INSTALL, doc/README, doc/TODO, doc/developer.txt, email/script/report_perday, email/script/report_perhour: email per day and per hour scripts now use generic querycalc-tidy, instead of customized tidy-it awk thingie. 2000-11-28 23:38 Joost van Baal * README, configure.in, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/man/lr_log2mail.pod, all/man/lr_spoold.pod, all/script/dlf_sum, all/script/dlf_total, all/script/dlf_uniq, all/script/lr_addresses2serviceflags, all/script/lr_getaddresses, all/script/querycalc, all/script/querycalc-tidy, all/script/querycalc-tidy-pre, doc/developer.txt: more manpage cosmetics 2000-11-28 22:22 Joost van Baal * doc/: developer.txt, fhs.txt, quickstart-developer.txt: doc reshuffling 2000-11-28 22:16 Joost van Baal * INSTALL, Makefile.am, README, configure.in, dns/Makefile.am, dns/script/Makefile.am, doc/fhs.txt, email/Makefile.am, email/etc/Makefile.am, email/lib/Email.pm, email/lib/Makefile.am, email/script/Makefile.am, email/script/filter, email/script/filter-messages, email/script/report_size, socks/script/socks2dlf, www/Makefile.am, www/script/Makefile.am, www/script/report_bytesperday, www/script/report_requestsperday: cosmetics: manpage twiddling, adding copyright statement. 2000-11-28 21:07 Joost van Baal * INSTALL, TestRun, all/Makefile.am, all/etc/Makefile.am, all/etc/address.cf, all/lib/Dlf.pm, all/lib/Lr_logger.pm, all/lib/Makefile.am, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/man/Makefile.am, all/man/lr_log2mail.pod, all/man/lr_spoold.pod, all/script/Makefile.am, all/script/dlf2report, all/script/dlf_sum, all/script/dlf_total, all/script/lr_addresses2serviceflags, all/script/lr_config2sh, all/script/lr_desyslog, all/script/lr_log2mail.pod, all/script/lr_smtpfield, all/script/lr_spoold.pod, all/script/querycalc, all/script/querycalc-tidy, all/script/querycalc-tidy-pre, all/src/Makefile.am, all/src/add_tm_key.c, all/src/lseek.c, doc/README, doc/TODO, doc/adding_service.txt, doc/fhs.txt, doc/log.txt, doc/lr_scheduler.txt, doc/overview-cron.txt, doc/overview.txt, doc/quickstart-developer.txt, doc/roadmap.txt, include/rules.mk: anonimize examples, cleanup obsolete stuff - phase I 2000-11-28 12:55 Joost van Baal * INSTALL, Makefile.am, README, configure.in, all/lib/Sum.pm, doc/fhs.txt: querycalc now no longer complains about Print. we should fix this in a nicer way, though... 2000-11-28 10:47 Joost van Baal * Makefile.am, configure.in, all/script/dlf_uniq, all/script/lr_addresses2serviceflags, all/script/lr_getaddresses, doc/fhs.txt, email/lib/Email.pm: fixed some manpages. autoconf-ed qmail and postfix 2000-11-27 16:55 Joost van Baal * all/script/: Makefile.am, lr_log2mail.pod, lr_smtpfield, lr_spoold.pod: now manpages get installed. 2000-11-27 16:41 Joost van Baal * all/script/Makefile.am, doc/INSTALL, doc/directory-overview, doc/fhs.txt, doc/install, doc/makefiles, doc/overview.txt: wrote some manpages, updated docs. 2000-11-27 13:30 Joost van Baal * dns/: Makefile.am, script/Makefile.am: bind8 and dns use new install scheme 2000-11-27 13:27 Joost van Baal * Makefile.am, configure.in, all/etc/address.cf, dns/script/distribution-requesttypes, dns/script/dlf-dns2report, dns/script/report, dns/script/top10-requestednames, dns/script/top10-requestinghosts: moved bind8 processing to new setup without scheduler. 2000-11-24 01:29 Joost van Baal * Makefile.am, email/Makefile.am, email/etc/Makefile.am, email/etc/mailfilter, email/lib/Makefile.am, email/lib/email.pm, email/script/Makefile.am: sendmail and email autoconf-ed 2000-11-23 13:46 Joost van Baal * INSTALL, configure.in, all/lib/Makefile.am, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/script/Makefile.am, doc/fhs.txt, include/rules.mk: added manpages 2000-11-23 11:05 Joost van Baal * all/lib/Makefile.am, all/script/Makefile.am, all/src/Makefile.am, doc/fhs.txt: more manpages will get automagically installed 2000-11-23 09:41 Joost van Baal * TestRun, all/etc/defaults, all/etc/logreportrc, all/etc/profile_lean, all/lib/Dlf.pm, all/lib/Lr_logger.pm, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/script/desyslog, all/script/dlf2report, all/script/dlf_sum, all/script/dlf_total, all/script/dlf_uniq, all/script/log2report, all/script/lr_addresses2serviceflags, all/script/lr_config2sh, all/script/lr_desyslog, all/script/lr_getaddresses, all/script/lr_getbody, all/script/lr_inflate, all/script/lr_log2mail, all/script/lr_processmail, all/script/lr_smtpfield, all/script/lr_spool, all/script/lr_spoold, all/script/process_sendabort, all/script/querycalc, all/script/querycalc-tidy, all/script/querycalc-tidy-pre, all/src/add_tm_key.c, all/src/lseek.c, dns/script/distribution-requesttypes, dns/script/dlf-dns2report, dns/script/report, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/README, doc/TODO, doc/adding_service.txt, doc/directory-overview, doc/install, doc/log.txt, doc/lr_scheduler.txt, doc/makefiles, doc/overview-cron.txt, doc/overview.txt, doc/quickstart-developer.txt, doc/roadmap.txt, email/etc/defaults, email/etc/dlf.cfg, email/etc/dlf.default, email/etc/mailfilter, email/etc/muttrc, email/lib/Email.pm, email/lib/email.pm, email/script/filter, email/script/filter-messages, email/script/report, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, email/script/test, include/bsd.m4, socks/script/socks2dlf, www/script/report, www/script/report_bytesperday, www/script/report_bytesperresult, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage, www/script/report_requestsperday: renamed doc/gpl.txt to COPYING, for that's the usual name. 2000-11-22 17:50 Joost van Baal * configure.in, doc/fhs.txt, www/script/Makefile.am, www/script/report, www/script/report_bytesperresult, www/script/report_requestsperday: debugged new www report scripts. 2000-11-22 17:04 Joost van Baal * configure.in, all/Makefile.am, all/script/Makefile.am, all/script/dlf_sum, all/script/dlf_total, all/src/add_tm_key.c, www/script/report, www/script/report_bytesperday, www/script/report_httpresult, www/script/report_requestsperday: added new apache reports, on request of sch. 2000-11-21 23:55 Joost van Baal * INSTALL, README, configure.in, doc/INSTALL, doc/README, doc/fhs.txt, email/script/add_tm_key.c: gonna build package for Jakob. updated INSTALL and README. focussing on apache common logs. 2000-11-21 21:43 Joost van Baal * all/Makefile.template, all/lib/Makefile.template, all/script/Makefile.template, dns/Makefile.template, dns/script/Makefile.template, email/Makefile.template, email/etc/Makefile.template, email/lib/Makefile.template, email/script/Makefile.template, socks/Makefile.template, socks/script/Makefile.template, www/script/Makefile.template: new install scheme. we're no longer using our homebrew Makefile.templates, but we're using GNU autotools' Makefile.am's, just as everybody else ;-) 2000-11-21 21:37 Joost van Baal * INSTALL, Makefile.am, Makefile.minimalist, Makefile.template, configure.baroque, configure.in, all/Makefile.am, all/etc/Makefile.am, all/etc/Makefile.template, all/etc/address.cf, all/etc/defaults, all/etc/profile_lean, all/lib/Makefile.am, all/script/Makefile.am, all/script/lr_log2mail, all/script/mailreport-cron, all/script/process_dlf, all/script/receive_mail, doc/fhs.txt: cleanup of tree, to go for new installer. added some error checks to lr_log2mail. apache-access_log2dlf takes an argument, not an option. 2000-11-21 00:33 Joost van Baal * 0Readme, all/src/Makefile, doc/gpl.txt: renamed 2000-11-21 00:30 Joost van Baal * AUTHORS, COPYING, ChangeLog, INSTALL, Makefile.am, Makefile.minimalist, NEWS, README, aclocal.m4, install-sh, missing, mkinstalldirs, all/Makefile.am, all/etc/Makefile.am, all/lib/Makefile.am, all/script/Makefile.am, include/rules.mk, www/script/report_bytesperresult: autoconf and automake stuff 2000-11-21 00:26 Joost van Baal * configure.in, all/script/lr_processmail, all/src/Makefile, doc/fhs.txt, email/etc/defaults, email/script/report, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, www/script/report, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage: cleaned up report_ scripts. added some autoconf and automake stuff 2000-11-19 18:56 Joost van Baal * all/script/: lr_smtpfield, smtp-field: renamed 2000-11-19 18:55 Joost van Baal * all/script/lr_addresses2serviceflags, all/script/lr_getaddresses, all/script/lr_getbody, all/script/lr_processmail, all/script/lr_spool, all/script/lr_spoold, doc/fhs.txt, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain: pasted gpl in. added some notes on usage. 2000-11-17 11:34 Joost van Baal * all/etc/address.cf, all/etc/defaults, all/etc/logreportrc, all/lib/Dlf.pm, all/script/lr_addresses2serviceflags, all/script/lr_desyslog, all/script/lr_getaddresses, all/script/lr_log2mail, all/script/lr_spool, all/script/lr_spoold, email/lib/Email.pm, email/script/report_fromusersperfromdomain, www/script/report: new spooler productional, to flush the inbox 2000-11-16 19:48 Joost van Baal * all/script/lr_processmail: used to be called process-mail. 2000-11-16 19:47 Joost van Baal * all/script/: lr_spoold, receive_mail.-s.email.-p.sendmail: lr_spoold - we dont wanna flush the maildir from cron. we wanna handle the stderr stuff sanely 2000-11-16 17:49 Joost van Baal * all/etc/profile_lean, all/script/lr_inflate, all/script/lr_log2mail, all/script/querycalc, all/script/querycalc-tidy, doc/fhs.txt, email/etc/dlf.cfg, email/script/report: sendmail responder back alive. using new setup. 2000-11-16 14:36 Joost van Baal * all/etc/profile_lean, all/script/logfile, all/script/lr-log2mail, all/script/lr_getbody, all/script/lr_log2mail, all/script/lr_spool, all/script/mailreport, doc/fhs.txt: resurrected our old spooling mechanism, so that we can flush the mailbox without the scheduler. sanitized logging output. removed some obsolete junk. 2000-11-15 01:09 Joost van Baal * configure.in, doc/fhs.txt: configure.in : we'd like to use a new configure and Makefile.in to install the stuff. moved postfix.logformat to doc section. 2000-11-15 01:07 Joost van Baal * all/script/: lr_getbody, lr_inflate, process_mail: working on new receiver. see fhs.txt to see how far we got. still very unstable. DO NOT INSTALL. 2000-11-14 11:45 Joost van Baal * all/lib/Lr_logger.pm, all/script/lr-log2mail, all/script/mailreport-fromlocallogfile, all/script/querycalc, email/etc/defaults, email/etc/signature, email/script/filter, email/script/filter-messages, email/script/report, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain: we're now able to send a postfix report with one command, in the new style system. see postfix/doc/scribble. still NO INSTALLER. still INCOMPATIBLE WITH THE OLD SYSTEM. so DO NOT INSTALL. 2000-11-13 23:29 Joost van Baal * all/etc/profile_lean, all/script/mailreport-fromlocallogfile, all/script/querycalc, all/script/querycalc-tidy, www/script/report, www/script/report_clienthost, www/script/report_httpresult, www/script/report_httpresultperclient, www/script/report_pagesperclienthost, www/script/report_requestedpage: first shot at different filesystem layout. we wanna get it Filesystem Hierarchy Standard compliant (http://www.pathname.com/fhs/), to be able to make a nice package from it in the future. The idea is this: ./logreport/usr/lib/logreport/www/apache/apache-access_log2dlf ./logreport/usr/lib/logreport/www/report ./logreport/usr/lib/logreport/www/report_clienthost ./logreport/usr/lib/logreport/www/report_httpresult ./logreport/usr/lib/logreport/www/report_httpresultperclient ./logreport/usr/lib/logreport/www/report_pagesperclienthost ./logreport/usr/lib/logreport/www/report_requestedpage ./logreport/usr/lib/logreport/querycalc ./logreport/usr/lib/logreport/querycalc-tidy ./logreport/usr/lib/perl5/LogReport/Time.pm ./logreport/usr/lib/perl5/LogReport/Lr_logger.pm ./logreport/usr/lib/perl5/LogReport/Sum.pm ./logreport/usr/bin/mailreport-fromlocallogfile ./logreport/etc/logreport/defaults ./logreport/etc/logreport/profile_lean ./logreport/etc/logreport/www/apache/defaults ./logreport/etc/logreport/www/defaults ./logreport/etc/logreport/www/dlf.cfg ./logreport/etc/logreport/www/muttrc ./logreport/etc/logreport/www/signature ./logreport/etc/logreport/disclaimer ./tmp/ . could be /home/lrrcv, or, ./logreport could be /, or, ./logreport/usr could be /usr/local: we would like to get this configurable. Furthermore, we're able to generate apache reports without even _installing_ the scheduler now. BEWARE! the suite is NOT INSTALLABLE now. Only the apache scripts have been tested to work with this. The configure script and the Makefiles have not been adapted, and will probably crash and burn now. 2000-11-13 15:49 Joost van Baal * configure, configure.baroque: we're gonna make us a configure.in and a Makefile.in, to be able to do a non-bloated clean install. 2000-11-13 15:02 Joost van Baal * 0Readme, www/script/Makefile.template: added to get ipfilter, qmail installed 2000-11-13 14:49 Joost van Baal * 0Readme, Makefile.template: added some comments to readme file. first step to adding apache, qmail and ipfilter to install. 2000-11-12 16:52 Joost van Baal * www/script/: report, report-fromlocallog, report_clienthost, report_httpresult, report_httpresultperclient, report_pagesperclienthost, report_requestedpage: some scripts to make the apache report a bit more interesting. 2000-11-12 16:48 Joost van Baal * all/script/mailreport-fromlocallogfile, all/script/querycalc-tidy, www/script/report_pagesperclienthost: now generates usefull apache logs. querycalc-tidy doesn't print too long lines any longer, which generated ugly reports in the past. now able to overwrite logging mode on commandline. mailreport-fromlocallogfile generates report from logfile on local disk. it's able to give the sent out email message an informative subject. 2000-11-12 00:42 Joost van Baal * all/etc/profile_lean: fixed $SUPERSERVICE/$SERVICE bug in PATH setting. 2000-11-06 16:15 Joost van Baal * all/etc/defaults.template, email/script/report: we can overwrite LOGGING from the command line. updated comments in report. 2000-11-06 13:06 Joost van Baal * all/: script/desyslog, src/tai64nfrac.c: tools to convert logfiles as produced by loggers using various timestamp mechanisms to a generic timestamped format 2000-11-02 23:34 Joost van Baal * email/lib/email.pm: did some indentation fixing. 2000-11-02 21:22 Joost van Baal * all/lib/Dlf.pm: added docs. added routine to generate dlf record from hash, using dlf.cfg's recipe 2000-11-02 13:03 Joost van Baal * all/: etc/profile_lean, lib/Dlf.pm, lib/Time.pm: tested and debugged ipmon2dlf. now actually generates dlf from ipfilter logs. profile_lean sets LR_HOME, so that this can be used by scripts, instead of HOME. Syslog.pm now handles both pid and processname. Fixed some indentation in Time.pm. ipfilter/etc/dlf.* are used by ipmon2dlf. scripts parsing the dlf should use these too. 2000-11-01 16:33 Joost van Baal * all/lib/Dlf.pm: interface to parse dlf config files, for perl scripts like e.g. convertors. not tested yet. 2000-11-01 16:30 Joost van Baal * all/lib/Syslog.pm, doc/TODO: first shot at ipfilter convertor. made Syslog.pm get both program name and pid, if found. not tested yet. did some formatting on TODO file. 2000-10-07 13:37 Joost van Baal * 0Readme, doc/TODO: 0Readme: added name + version header; added some notes in the full installation section. doc/TODO: added a few items that came up on a final set of test runs. 2000-10-03 23:28 Jan Stap * 0Readme, configure: Updated w.r.t. autorunning bin/lr_config2sh. 2000-10-03 22:08 Jan Stap * all/script/log2report: Made usage text clearer; now runs lr_config2sh itself, if etc/lr_config.sh is missing. 2000-10-01 20:58 Jan Stap * 0Readme: Added description of log2report usage; ran over the rest of the text. Must admit: still have to test log2report invoked through a mail alias (I guess I will have to set PATH in the script). 2000-10-01 18:54 Jan Stap * TestRun: Changes: - passed system type to configure (was fixed to gnu) - added text to optionally redirect stderr - removed setting $LOGGING, since this is fixed now in all/etc/defaults.template 2000-10-01 18:07 Jan Stap * all/etc/defaults.template: Added placeholder for default value for $LOGGING, such that TestRun and other programs don't need to set this (actually this missing placeholder was a bug). The configure script sets this default in etc/defaults. 2000-10-01 17:34 Jan Stap * TestRun: Added export LOGGING=stderr (is set to "logreport" by default in etc/defaults). Now socket errors are gone when using the test mode. 2000-10-01 15:24 Jan Stap * TestRun: Changed "simple" into "basic", due to change in configure. 2000-09-30 21:48 Jan Stap * configure: Made instruction text clearer (hopefully); changed installation type "simple" into "basic" (was not so pleased with simple). 2000-09-30 21:16 Jan Stap * all/etc/Makefile.template: Added logreportrc as extra file to be installed; saves the user transporting it to the remote machine for a remote install. 2000-09-30 20:02 Joost van Baal * 0Readme: applied Anton's patch 2000-09-30 12:00 Joost van Baal * all/script/querycalc-tidy: uses lr_logger to log, as it should. 2000-09-30 11:53 Joost van Baal * all/script/querycalc-tidy: now skips bogus input: no longer chokes on it. 2000-09-30 10:42 Joost van Baal * all/script/querycalc-tidy: we wanna get rid of: Use of uninitialized value at /home/hibou/bin/querycalc line 766. Use of uninitialized value at /home/hibou/bin/querycalc line 785. Use of uninitialized value at /home/hibou/bin/querycalc-tidy line 51, <> chunk 1 . started documenting querycalc-tidy. moved copyright to pod. perhaps we could use more pod in our scripts, to document them. 2000-09-30 00:38 Peter Huisken * 0Readme: Added some conservative remarks. 2000-09-30 00:21 Peter Huisken * doc/roadmap.txt: Development roadmap. 2000-09-29 22:35 Joost van Baal * doc/TODO: added note about compiling ls_scheduler, lr_logger on remote host 2000-09-29 21:22 Peter Huisken * TestRun: Small fix for changed configure 2000-09-29 17:13 Jan Stap * all/script/lr_config2sh: Removed code checking for a $HOME/.logreportrc due to problems and time pressure. Left for later. 2000-09-29 17:12 Jan Stap * all/script/log2report: No longer the $logger_cmd is exported to specify how/where to log, but the $LOGGING variable. Needed because the old logger() function using $logger_cmd did not work with the scheduler. 2000-09-29 17:09 Jan Stap * all/etc/defaults.template: Rewritten definition of logger() function, since my old one did not work with the scheduler. 2000-09-29 17:07 Jan Stap * all/etc/Makefile.template: Removed code for auto generation of etc/lr_config.sh at installation time; to be left for later. 2000-09-29 17:06 Jan Stap * configure: Changes: - HOME -> LR_HOME - fixed directories w.r.t. trailing slahes - log definition changed slightly (see etc/defaults.template) - updated/expanded explanation to the user about what to do next 2000-09-29 01:23 Jan Stap * all/script/lr_config2sh: Now checks for an existing $HOME, so to source $HOME/.logreportrc if available; must be done for all scripts now sourcing only /etc/logreport/logreportrc. Required: make an $LR_HOME (the installation base directory), separate from $HOME (the users' home directory). 2000-09-29 01:19 Jan Stap * all/script/log2report: Changed command line interface: less complex, and allows for parallel output to file and mail. 2000-09-29 01:16 Jan Stap * all/etc/Makefile.template: Added entry to make lr_config.sh from lr_config; works due to the fact that first a make on all/script and then on all/etc is done; with the proper dependencies behind the lr_config.sh: entry, I get circular dependency problems, so I leave them out for the moment. 2000-09-29 01:12 Jan Stap * configure: Added stuff to support a $HOME/.logreportrc; does not work yet. 2000-09-27 04:10 Jan Stap * all/script/lr_config2sh: Solved bug in paths to report programs. 2000-09-27 04:09 Jan Stap * all/script/log2report: Many changes, most of which needed to get the logging in place. Some bug fixes. The construct with the command variable in a logging() function in etc/defaults was chosen because log2report needs to export a logging destination (stderr / syslog) to the scripts called. Exporting functions in /bin/sh is far from portable, so an env. variable was used. Since each script sources etc/defaults, it knows the logging() function and fills in the imported log command var. Using just an env. variable would be possible, but result in less abstraction (logger may be a program, alias or function; $logger always is an env. variable). 2000-09-27 03:48 Jan Stap * all/script/Makefile.template: Added lr_config2sh script to be installed. 2000-09-27 03:47 Jan Stap * all/etc/defaults.template: Added: - PATH=$HOME/bin:$PATH to find querycalc (amongst others) - symbolic logger names, in order to keep the program definitions in etc/defaults, and still be able to let the user switch the log destination A single logger() function now uses a command variable, which eases an external script (log2report) to export the correct log command, which all other scripts then use transparently by just calling "logger ". 2000-09-27 03:41 Jan Stap * configure: Various: - corrected bug with unwanted trailing slash in homedir in lr_config - finds system logger program for syslog logging - changed "$a" = "" tests into -z "$a" - now writes extra log-related variables to etc/defaults 2000-09-26 00:03 Jan Stap * all/script/log2report: Some bug fixes after first test. 2000-09-26 00:02 Jan Stap * all/script/Makefile.template: Added install of log2report to /bin. 2000-09-25 00:56 Jan Stap * all/script/log2report: Added wrapper script calling all modules directly (to be tested still). 2000-09-25 00:28 Jan Stap * all/script/smtp-field: Added check on being an RFC822 message or a plain log file; set check on literal space to \s; added usage text; reversed command line (now 1st arg is required; 2nd one is optional) 2000-09-25 00:22 Jan Stap * all/script/process_dlf: Removed duplicate code (KEEP checking). 2000-09-24 10:34 Jan Stap * all/script/lr_config2sh: Solved commit conflict. 2000-09-24 00:55 Joost van Baal * 0Readme: added note about sendmail peculiarities. btw, still installable on FreeBSD boxes. 2000-09-24 00:27 Joost van Baal * 0Readme, Makefile.template, TestRun, configure, all/Makefile.template, all/etc/Makefile.template, all/etc/defaults.template, all/etc/dot-qmail-bind8-log, all/etc/dot-qmail-postfix-log, all/etc/dot-qmail-sendmail-log, all/etc/logreportrc.template, all/etc/lr_scheduler, all/etc/profile_lean, all/lib/Lr_logger.pm, all/lib/Makefile.template, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/script/Makefile.template, all/script/dlf2report, all/script/dlf_uniq, all/script/logfile, all/script/lr_config2sh, all/script/lr_getbody, all/script/lr_inflate, all/script/mailreport, all/script/mailreport-cron, all/script/mailreport-fromlocallogfile, all/script/process_dlf, all/script/process_mail, all/script/process_mailbody, all/script/process_sendabort, all/script/process_sendreport, all/script/querycalc, all/script/querycalc-tidy, all/script/querycalc-tidy-pre, all/script/receive_mail, all/script/receive_mail.-s.email.-p.sendmail, all/script/smtp-field, all/script/to, all/src/Makefile, all/src/lseek.c, dns/Makefile.template, dns/script/Makefile.template, dns/script/distribution-requesttypes, dns/script/dlf-dns2report, dns/script/report, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/TODO, doc/adding_service.txt, doc/directory-overview, doc/install, doc/log.txt, doc/lr_scheduler.txt, doc/makefiles, doc/overview-cron.txt, doc/overview.txt, doc/quickstart-developer.txt, email/Makefile.template, email/etc/Makefile.template, email/etc/defaults, email/etc/dlf.cfg, email/etc/mailfilter, email/etc/muttrc, email/lib/Makefile.template, email/lib/email.pm, email/script/Makefile.template, email/script/add_tm_key.c, email/script/filter, email/script/filter-messages, email/script/report, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, email/script/test, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu, include/bsd.m4, include/gnu.m4, socks/Makefile.template, socks/script/Makefile.template, socks/script/socks2dlf: adapted license text: LogReport@LogReport.org is our contact address. 2000-09-23 23:57 Joost van Baal * 0Readme, configure: fixed typo in readme. got rid of == in tests. (is that a bash-ism? anyway, it fails on FreeBSD's /bin/sh.) 2000-09-21 23:40 Jan Stap * all/script/lr_config2sh: Added script that generates a shell-script from all/etc/lr_config, which can be sourced to obtain the config information from this file. Is used in wrapper-script (under construction) calling all modules directly. 2000-09-21 23:38 Jan Stap * configure: Now also sets LOGGING variable and writes all/etc/defaults. 2000-09-21 23:36 Jan Stap * all/etc/defaults: Renamed to defaults.template. 2000-09-21 23:36 Jan Stap * all/etc/defaults.template: Renamed from defaults; var LOGGING is filled in by configure, depending on the type of install: stderr for mode without scheduler; logreport for mode with. 2000-09-19 21:50 Jan Stap * all/etc/lr_config: Removed (is now generated). Possible alternative: lr_scheduler reads home directory from the environment, set by /etc/logreport/logreportrc. 2000-09-19 21:48 Jan Stap * all/etc/lr_config.template: File lr_config is generated from this one by configure. 2000-09-19 21:45 Jan Stap * configure: Added setting the home directory into lr_config. 2000-09-19 21:44 Jan Stap * 0Readme: Added option -u to configure in example 2000-09-19 00:43 Jan Stap * all/etc/logreportrc: Removed, since is now built by configure from logreportrc.template 2000-09-19 00:41 Jan Stap * all/etc/logreportrc.template: System-wide config file template 2000-09-19 00:35 Jan Stap * include/: Makefile.geninst.bsd, Makefile.geninst.gnu: Made placeholders moe unique: _xxx_ in stead of _xxx 2000-09-19 00:33 Jan Stap * configure: Added entering remote user; writes user and home dir. into all/etc/logreportrc. This info will also go into all/etc/lr_scheduler and all/etc/lr_config (1st line). To be done: - the scheduler passes the home dir. $HOME in the env. of the called scripts; - likewise the non-scheduler pipe-script will do so; - then no /etc/logreportrc file will be needed (requires root access) 2000-09-18 01:19 Jan Stap * doc/TODO: Added items that came up in the email exchange with Brad Knowles 2000-09-17 23:46 Jan Stap * all/script/receive_mail: Committed for Joost: now uses logreport_user and logreport_home (configurable remote user). 2000-09-17 23:43 Jan Stap * all/etc/: logreportrc, lr_scheduler: Committed for Joost: changes due to configurable remote user. logreportrc sets logreport_user (= remote user), logreport_home and HOME. To be checked with new configure stuff. 2000-09-17 23:38 Jan Stap * 0Readme: Committed for Joost: remote user name (was lrrcv) is now configurable. Plus more explanation. 2000-09-15 02:27 Jan Stap * include/: Makefile.geninst.bsd, Makefile.geninst.gnu: Corrected DESTDIR default: no trailing slash, due to user@host: format for the full install case. 2000-09-15 02:23 Jan Stap * configure, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu: Due to need for a simple install scenario, changed configure to ask for: - gnu or bsd make - simple or full install - simple install: directory where to install into - full install: host where to install onto Parameters can be given on the command line too; missing ones are asked for. Simple install: - no ssh used -> only local installation - no scheduler -> only for low-volume log processing Full install: - the install as it used to be (ssh + to lrrcv@host) Todo: - make wrapper-script, calling all programs in a pipe: log file in - report out; will be the interface for the simple install case 2000-09-15 00:49 Jan Stap * include/gnu.m4: Corrected comment: bsd -> gnu. 2000-09-13 09:51 Joost van Baal * 0Readme, all/etc/lr_scheduler: some more freebsd notes. 2000-09-13 09:02 Joost van Baal * 0Readme: some notes on required software 2000-09-13 02:27 Joost van Baal * 0Readme: some more notes on installing. gonna sleep now. 2000-09-13 02:02 Joost van Baal * 0Readme, doc/quickstart-developer.txt: added some notes on FreeBSD installs. 2000-09-13 00:51 Joost van Baal * 0Readme: restored after conflicts. 2000-09-13 00:42 Jan Stap * 0Readme: Explained about the two installation methods; started with the test installation description. Added-in Joost's description of doc files. 2000-09-13 00:32 Jan Stap * TestRun: Added missing ./configure [ gnu | bsd ] and added this argument to the TestRun script. 2000-09-13 00:24 Joost van Baal * doc/quickstart-developer.txt: how to get started, for commiters 2000-09-12 23:57 Joost van Baal * 0Readme: fixed some minor errors. 2000-09-12 23:38 Jan Stap * TestRun: Minor: call report directly as email/bin/report. 2000-09-12 23:37 Jan Stap * 0Readme: Added: - explained where root access is needed (for sendmail/postfix systems) - commands to set owner of mailboxes - starting lr_scheduler as user lrrcv requires typing its password - test run: report is not in file, but in returned mail message - quick troubleshooter in case test run fails 2000-09-09 08:59 Joost van Baal * all/script/mailreport, all/script/process_sendreport, doc/TODO, email/etc/signature: did some cosmetics on signature files. process_sendreport now appends signature and disclaimer. added "phased out" warning to mailreport. 2000-09-09 08:29 Joost van Baal * all/etc/Makefile.template: now disclaimer gets installed by make-ing 2000-09-09 08:27 Joost van Baal * all/: etc/defaults, etc/disclaimer, script/mailreport: disclaimer gets appended to sent out report. 2000-09-04 20:05 Joost van Baal * doc/log.txt: removed remark which reminds of things we'd like to forget 2000-09-04 08:26 Jan Stap * 0Readme: Made all distribution file references relative to service/, such that a tarball can be made within service/. 2000-09-04 01:07 Jan Stap * Makefile.template, TestRun, configure, all/Makefile.template, all/etc/Makefile.template, all/etc/dot-qmail-bind8-log, all/etc/dot-qmail-postfix-log, all/etc/dot-qmail-sendmail-log, all/etc/lr_scheduler, all/etc/profile_lean, all/lib/Lr_logger.pm, all/lib/Makefile.template, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/script/Makefile.template, all/script/dlf2report, all/script/dlf_uniq, all/script/logfile, all/script/lr_getbody, all/script/lr_inflate, all/script/mailreport, all/script/mailreport-cron, all/script/mailreport-fromlocallogfile, all/script/process_dlf, all/script/process_mail, all/script/process_mailbody, all/script/process_sendabort, all/script/process_sendreport, all/script/querycalc, all/script/querycalc-tidy, all/script/querycalc-tidy-pre, all/script/receive_mail, all/script/receive_mail.-s.email.-p.sendmail, all/script/smtp-field, all/script/to, all/src/Makefile, all/src/lseek.c, dns/Makefile.template, dns/script/Makefile.template, dns/script/distribution-requesttypes, dns/script/dlf-dns2report, dns/script/report, dns/script/top10-requestednames, dns/script/top10-requestinghosts, doc/TODO, doc/adding_service.txt, doc/directory-overview, doc/install, doc/log.txt, doc/lr_scheduler.txt, doc/makefiles, doc/overview-cron.txt, doc/overview.txt, email/Makefile.template, email/etc/Makefile.template, email/etc/defaults, email/etc/dlf.cfg, email/etc/mailfilter, email/etc/muttrc, email/lib/Makefile.template, email/lib/email.pm, email/script/Makefile.template, email/script/add_tm_key.c, email/script/filter, email/script/filter-messages, email/script/report, email/script/report_delay, email/script/report_error, email/script/report_fromdomain, email/script/report_fromrelay, email/script/report_fromusersperfromdomain, email/script/report_perday, email/script/report_perhour, email/script/report_size, email/script/report_todomain, email/script/report_torelay, email/script/report_touserspertodomain, email/script/test, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu, include/bsd.m4, include/gnu.m4, socks/Makefile.template, socks/script/Makefile.template, socks/script/socks2dlf: Added GPL license text. 2000-09-04 01:00 Jan Stap * all/etc/defaults: Set LOGGING=logreport as the default, since a default installation uses this value. 2000-09-04 00:59 Jan Stap * 0Readme: Added license text and removed editing etc/defaults (is now set to LOGGING=logreport by default); corrected mutt example. 2000-09-04 00:01 Jan Stap * TestRun, all/etc/lr_scheduler, all/script/receive_mail.-s.email.-p.sendmail: Added missing CVS Id tag. 2000-09-03 21:48 Jan Stap * doc/gpl.txt, email/script/add_tm_key.c, email/script/report_perday, email/script/report_perhour: Added missing CVS Id tag. 2000-09-03 18:30 Jan Stap * doc/gpl.txt: Added copy of the GPL, which is referred to by the license text to be added now to each source file. 2000-09-03 17:24 Jan Stap * 0Readme: Minor changes; updated test run to use TestRun script. 2000-09-03 17:21 Jan Stap * all/etc/Makefile.template: Added lr_config to the list of files to be installed in ~lrrcv/etc. 2000-09-03 17:19 Jan Stap * all/etc/: lr_config, lr_scheduler: Moved all/scheduler/lr_config to all/etc/lr_config; edited all/etc/lr_scheduler to use all/etc/lr_config (scheduler could not find its lr_config file). 2000-09-03 15:45 Jan Stap * TestRun: Corrected // in path names; added PERLLIB var and sourcing etc/defaults; minor change to example run text. Example runs now work and installation to ~lrrcv/TestDir still works ok. 2000-09-03 15:41 Jan Stap * include/: Makefile.geninst.bsd, Makefile.geninst.gnu: Removed "" from SRDIRS variable (quotes are litterally included in the variable). Tested installation to ~lrrcv and to TestDir: both still work ok. 2000-09-03 14:12 Jan Stap * 0Readme: Made some corrections and additions (setting up the responder, getting mutt, editing /etc/services and /etc/syslog.conf files) 2000-09-02 23:24 Peter Huisken * TestRun: This little script creates a test environment in which the various programs and scripts can be run without the responder. This should speed up development, as well as make life simpler for novice users. 2000-09-02 23:12 Peter Huisken * all/script/Makefile.template: Fixed small typo in added "fixpermissions". Remember to add a tab at the beginning of an action line in make. 2000-09-02 17:59 Jan Stap * all/script/Makefile.template: Added fixpermissions target to make all files under ~lrrcv/bin executable. 2000-09-02 11:49 Peter Huisken * 0Readme, Makefile.template, dns/script/Makefile.template, email/script/Makefile.template, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu, socks/script/Makefile.template: Changed SSH commands. All commands are quoted now: o No wildcard expansion at the wrong place. o Easier with alternative SSH commands Fixed some make install commands. All directories are created in a for loop now. It is possible to test and run the responder, as well as the various scripts in your own account. This enables a much larger group of people to try the sw. For Linux hackers like us, it is always easy to conceive that people do not have access to the root passwd. In fact, the majority of the UNIX community does not have such powers. Therefore, it should be possible to install, test and run the software in your own account. This benefits us developers as well. Testing and running is much simpler and faster. Therefore, productivity increases; less hardware is required for the same work. This has been implemented in the following way: o Changes to makefiles templates in ../include o Supply alternative SCP and SSH commands: $ cd .../service $ export DESTDIR=$(pwd)/TestDir/ $ mkdir $DESTDIR $ export SCP=cp $ export SSH="cd $DESTDIR/; sh -c " $ make install $ HOME=`pwd`/TestDir PS1='LR_Test$ ' sh LR_Test$ cat /var/log/maillog | $DESTDIR/email/bin/report The following has been tested: o Make install local. o Make install with SSH to remote lrrcv user. o BSD make has not been tested o Only sendmail is tested. Probably, PERLLIB needs setting as well. No more time now, tuesday work continues. 2000-09-01 00:41 Peter Huisken * 0Readme, doc/TODO: Just a start for a readme file. 2000-08-31 21:30 Peter Huisken * doc/TODO: Documented some major pitfalls for the novice user. Added some programming style tips that may not be applauded by everybody. 2000-08-29 08:41 Joost van Baal * all/script/mailreport-fromlocallogfile: fixed bug in $# test. 2000-08-26 11:40 Peter Huisken * email/script/: report_perday, report_perhour: Iets breder output formaat: Wall-clock sent deferred bounced ------------------------------------------------------- :17: ............... 0 0 0 IPV Wall-clock sent deferred bounced ---------------------------------------- :17: 0 0 0 2000-08-26 09:30 Joost van Baal * all/script/mailreport-fromlocallogfile: addressee more flexible: on commandline, not in config file. todo: get mailreport-fromlocallogfile use the scheduler. 2000-08-26 09:12 Joost van Baal * doc/makefiles: querycalc bug in flag numbers is fixed, so got rid of evil workaround in www/etc/dlf.cfg 2000-08-25 21:55 Joost van Baal * all/script/mailreport-fromlocallogfile: no longer in debug mode. doesn't say "duh" any longer. 2000-08-22 23:38 Jan Stap * Makefile.template: Fixed bugs in install target: changed install to lrrcv in for loop and fixed dependency to create directories. Added www tree install, but disabled until that part is ready. 2000-08-22 22:32 Peter Huisken * email/script/: Makefile.template, add_tm_key.c, report, report_perday, report_perhour: Added the following reports: - Messages per day. Inspired on pflogsumm output. - Messages per hour. Inspired on pflogsumm output. The add_tm_key program is a small c program. It is in the "scripts" subdirectory... Tested locally: lrrcv$ email/bin/report /tmp/xyx.dlf querycalc -O -s ... needs attention 2000-08-22 00:08 Peter Huisken * all/etc/lr_scheduler, all/script/receive_mail.-s.email.-p.sendmail, doc/install: gonna sleep. mav: you're right. using /etc/aliases might be a better way. 2000-08-21 23:37 Peter Huisken * all/script/receive_mail.-s.email.-p.sendmail: wrapper for sendmail smrsh 2000-08-21 23:04 Peter Huisken * all/etc/lr_scheduler: wow! a restart flag. 2000-08-21 23:02 Peter Huisken * doc/install: let's save what we learn. 2000-08-21 22:41 Joost van Baal * all/etc/lr_scheduler: linux style /etc/init.d script 2000-08-16 18:43 Edwin Groothuis * all/script/querycalc: Fixed problem with subreports where the offset would be one too much. Thanks to Joost for the first report. 2000-08-13 14:36 Joost van Baal * doc/: adding_service.txt, makefiles: described usage of makefiles and configure 2000-08-07 17:49 Joost van Baal * all/script/mailreport-fromlocallogfile, www/script/report-fromlocallog, www/script/report_pagesperclienthost: hacked responder for local logs in. first report from apache logs. 2000-08-07 17:48 Joost van Baal * all/etc/: defaults, profile_lean: hacked local responder in. made a usefull report out of apache 2dlf stuff. 2000-08-07 16:40 Joost van Baal * all/lib/Lr_logger.pm: added informative error message 2000-07-03 00:55 Joost van Baal * all/etc/defaults, all/script/lr_getbody, all/script/process_dlf, all/script/process_mail, all/script/process_mailbody, doc/overview.txt, email/script/report: up and running again. still some loose ends: when doing lrrcv@gelfand ~$ lr_scheduler -p lr_scheduler.pid interesting stuff gets thrown over lrrcv's terminal. anyway, we're sending out reports again for sendmail. other services not yet tested. querycalc and querycalc-tidy still need tweaking. they suffer from 'Use of uninitialized value's. Added comments to defaults, about use of new KEEP and LOGGING variables. updated overview.txt. (needs tidying, still has got some obsolete stuff in it.) goodnight. 2000-07-02 22:43 Joost van Baal * configure: resolved cvs conflicts. 2000-07-02 22:39 Joost van Baal * all/script/: lr_getbody, process_dlf, process_mail: restored log messages, so that no only humans but also the scheduler can grok them. 2000-07-02 22:35 Edwin Groothuis * configure: Wow, it's now working under Debian (thank to their maintainers to break the /bin/sh is /bin/sh strategy) 2000-07-02 20:33 Joost van Baal * all/etc/defaults: got rid of bashism in test 2000-07-02 17:04 Joost van Baal * all/etc/defaults, all/lib/Lr_logger.pm, all/script/process_dlf, doc/overview.txt: Lr_logger respects LOGGING environment var now. got syntax error out of sendmail2dlf. 2000-07-02 16:43 Joost van Baal * all/script/process_dlf, all/script/process_mail, doc/overview.txt: fixed filenaming bug in process_dlf. updated docs. 2000-07-02 16:02 Joost van Baal * all/script/: lr_getbody, process_mail: fixed zcat bug in process_mail. logmessages follow policy now: blaat. 2000-07-02 15:15 Joost van Baal * all/etc/defaults, all/script/lr_getbody, all/script/lr_inflate, all/script/mailreport, all/script/mailreport-cron, all/script/process_dlf, all/script/process_mail, all/script/process_mailbody, all/script/process_sendabort, all/script/process_sendreport, all/script/querycalc-tidy, all/script/receive_mail, dns/script/report, doc/overview.txt, email/script/report: replaced $LOGGER by shell function logger(); to gain flexibility. we want to be able to test the script with logger() set to echo 1>&2 "$@" 2000-07-02 14:35 Joost van Baal * all/etc/defaults: now in deep debug mode. scheduler is temporaryly offline, to facilitate learning to know it by me. 2000-07-02 14:27 Joost van Baal * doc/overview.txt: made a start at documenting the scheduler system 2000-07-02 14:11 Joost van Baal * doc/overview-cron.txt: overview of the old, cron driven system. used to be called overview.txt 2000-06-30 16:42 Edwin Groothuis * doc/: directory-overview, lr_scheduler.txt: Updated documentation regarding lr_scheduler / directory overview 2000-06-30 00:00 Edwin Groothuis * Makefile.template, all/Makefile.template, all/script/Makefile.template, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu: Finally all the makefiles work on both BSD and GNU make 2000-06-29 00:07 Edwin Groothuis * all/script/querycalc: If you have an intervalled output, the begin and endtime of this interval is at the first two columns: [~/logs/dns] edwin@p6>cat dns.dlf | perl -I/home/lrrcv/lib /home/edwin/logreport/service/all/script/querycalc -T 1 "-O 2 --interval 86400 -c -s 3" 958402470 958488869 32 195.193.176.33 32 SOA 958402470 958488869 12 198.186.203.35 7 MX ^^^^^^^^^ ^^^^^^^^^ 2000-06-28 18:06 Edwin Groothuis * Makefile.template, all/script/Makefile.template, all/script/lr_getbody, all/script/process_dlf, all/script/process_mail, all/script/process_mailbody, all/script/process_sendabort, all/script/receive_mail, all/script/spoolcmd, dns/Makefile.template, email/Makefile.template, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu, socks/Makefile.template: - made logging in scripts more consistent - removed lrrcv from the makefiles in the directories 2000-06-27 18:04 Edwin Groothuis * Makefile.template, configure, all/Makefile.template, all/etc/Makefile.template, all/lib/Makefile.template, all/script/Makefile.template, dns/Makefile.template, dns/script/Makefile.template, email/Makefile.template, email/etc/Makefile.template, email/lib/Makefile.template, email/script/Makefile.template, include/bsd.m4, include/gnu.m4, socks/Makefile.template, socks/script/Makefile.template: Oh yes, Makefiles which created completly regarding your environment, what more do you want in life? (oh well, it's a first step towards it) 2000-06-27 09:06 Edwin Groothuis * Makefile, Makefile.template, configure, all/Makefile, all/Makefile.template, all/etc/Makefile, all/etc/Makefile.template, all/lib/Makefile, all/lib/Makefile.template, all/script/Makefile, all/script/Makefile.template, dns/Makefile, dns/Makefile.template, dns/script/Makefile, dns/script/Makefile.template, email/Makefile, email/Makefile.template, email/etc/Makefile, email/etc/Makefile.template, email/lib/Makefile, email/lib/Makefile.template, email/script/Makefile, email/script/Makefile.template, include/Makefile.geninst, include/Makefile.geninst.bsd, include/Makefile.geninst.gnu, socks/Makefile, socks/Makefile.template, socks/script/Makefile, socks/script/Makefile.template: First try to make the Makefiles make-independant (and a first step towards a real installation script) 2000-06-27 01:57 Edwin Groothuis * all/script/querycalc: Finally got it below the 14 seconds, that's all for tonight. 2000-06-27 01:29 Edwin Groothuis * all/script/querycalc: Improved querycalc a little by using 14 seconds instead of 18 seconds. 2000-06-26 00:14 Edwin Groothuis * doc/directory-overview: Updated docs 2000-06-26 00:08 Edwin Groothuis * Makefile, all/lib/Lr_logger.pm, all/lib/Makefile, all/lib/Sum.pm, all/lib/Syslog.pm, all/lib/Time.pm, all/lib/ToEpoch.pm, all/script/dlf2report, all/script/querycalc, dns/script/dlf-dns2report, email/lib/Log.pm, email/lib/Makefile, email/lib/email.pm: Moved all the "small" libs to LogReport:: 2000-06-25 19:01 Edwin Groothuis * all/script/querycalc: - Updated lr_protocol with identifier - Updated querycalc to support RE in filtering options - Updated querycalc to use lr_logger 2000-06-24 14:39 Edwin Groothuis * all/script/querycalc: Added --keep filter, which allows to filter out everything except this one. 2000-06-22 23:23 Edwin Groothuis * all/script/: Makefile, process_dlf, process_sendabort, process_sendreport: Added support for feedback of failed items like empty dlf-files Renamed tools to have the real name (like process_dlf -> process_mailbody) 2000-06-22 21:21 Edwin Groothuis * all/script/: process_dlf, process_mailbody, process_report: rename of files step 1 2000-06-22 17:36 Edwin Groothuis * Makefile, all/Makefile, include/Makefile.geninst: Make central makefile more usefull in comments, Added background-starting, pid/config-file specification to the scheduler 2000-06-22 16:33 Edwin Groothuis * all/: etc/crontab-nonqmail, etc/crontab-postfix, etc/crontab-qmail, etc/crontab-sendmail, script/lr_getbody, script/process_dlf, script/process_report: Removed crontab-thingies, made lr_getbody, process_dlf and preoces_report more Linux friendly (we should have sticked to windows, one world, one operating system!) 2000-06-20 00:14 Edwin Groothuis * dns/script/: Makefile, distribution-requesttypes, report, top10-requestednames, top10-requestinghosts: Added statistics generation into lr_scheduler: