Realtime data input to MySQL - Perl

dwakeman · 07-19-2004

I have just about completed a Perl script that will plot NS data directly into a MySQL DB. Obviously there are online sites (eg: wigle.net) that can handle this stuff for you, but I wanted to do collection/reporting/stats on my own as well.

It doesn't have fancy voice, or realtime MS Map plotting, but would anyone be interested in this? Since it's using Perl's DBI module, you could easily edit it to use pretty much any DB (Oracle, SQL Server, MySQL etc) without much fuss.

dave

dwakeman · 07-19-2004

Also, I will be writing a utility (also in Perl) to take data already contained in ns1 files and input it into the DB. The script above will be for realtime entry only.

wrzwaldo · 07-19-2004

I would be interested in the utility for post processing the ns1 files.

Thorn · 07-19-2004

I'd be interested in seeing these also.

dwakeman · 07-21-2004

Attached is the first script which collects realtime data and insert's it into a MySQL DB.

It's very simple, but it does it's job (mostly, see README.TXT).

If you have any new issues (not covered in the README), please post them here.

update: Also, I use tab spaces/width of 2 in my Perl IDE, so the code may look odd if you are using an editor (like notepad which uses 8) that uses any other value for tab spacing.

Thanks,
dave

dwakeman · 07-21-2004

I have noticed a few trends in it's failure to record data from specific hosts. I'll try and nail it down in the next few days and post an update.

nashr · 01-19-2005

I was doing some searching at cpan and came up with some perl modules for NetStumbler. Anyone know this guy, or tried these modules?

I may try to get to this sometime soon... yeah right. ok, eventually.

DSMcL · 04-04-2005

Did you ever get a chance to try them out Nashr ?

Just came across this thread in a search and figured if there wasn't any feedback on them yet I would throw together a simple script to give them a go.

Dave

nashr · 04-04-2005

Quote:

Originally Posted by DSMcL

Did you ever get a chance to try them out Nashr ?

Just came across this thread in a search and figured if there wasn't any feedback on them yet I would throw together a simple script to give them a go.

Dave

Dave
No, I've been totally swamped between work and trying to enhance my website for some tracking. I have not looked these over. I also haven't stumbled since Shmoocon.

Let me/us know if you get a chance to look them over.

07-19-2004	#1 (permalink)
dwakeman perlmonk Join Date: Jul 2004 Location: canadia Posts: 57	Realtime data input to MySQL - Perl I have just about completed a Perl script that will plot NS data directly into a MySQL DB. Obviously there are online sites (eg: wigle.net) that can handle this stuff for you, but I wanted to do collection/reporting/stats on my own as well. It doesn't have fancy voice, or realtime MS Map plotting, but would anyone be interested in this? Since it's using Perl's DBI module, you could easily edit it to use pretty much any DB (Oracle, SQL Server, MySQL etc) without much fuss. dave

07-19-2004	#4 (permalink)
Thorn Did you do the math? Join Date: Apr 2002 Location: Villa Straylight Posts: 10,039	I'd be interested in seeing these also. __________________ Thorn "Lawyers should never marry lawyers. This is called inbreeding. It produces idiot children and more lawyers."

01-19-2005	#7 (permalink)
nashr Uber Geek Join Date: Aug 2002 Location: Virginia Posts: 1,609	Perl Modules for NS at CPAN I was doing some searching at cpan and came up with some perl modules for NetStumbler. Anyone know this guy, or tried these modules? I may try to get to this sometime soon... yeah right. ok, eventually. __________________ Help! I've been Simpsonized!

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

07-19-2004	#2 (permalink)
dwakeman perlmonk Join Date: Jul 2004 Location: canadia Posts: 57	Also, I will be writing a utility (also in Perl) to take data already contained in ns1 files and input it into the DB. The script above will be for realtime entry only.

07-19-2004	#3 (permalink)
wrzwaldo I amuse you? Join Date: Dec 2003 Posts: 9,127	I would be interested in the utility for post processing the ns1 files.

07-21-2004	#6 (permalink)
dwakeman perlmonk Join Date: Jul 2004 Location: canadia Posts: 57	I have noticed a few trends in it's failure to record data from specific hosts. I'll try and nail it down in the next few days and post an update.

04-04-2005	#8 (permalink)
DSMcL Registered Member Join Date: Mar 2005 Posts: 2	Did you ever get a chance to try them out Nashr ? Just came across this thread in a search and figured if there wasn't any feedback on them yet I would throw together a simple script to give them a go. Dave