• FTN::Database/ftnpldb

    From Jame Clay@1:2320/100 to All on Fri Oct 1 18:13:02 2010
    All,

    File: ftnpldb.zip (14kB), Area: PERLMOD, Origin: 1:120/546
    Desc: FTN-Database modules and associated scripts which can be used for Fidonet/FTN related processing in an SQL database supported by a Perl
    DBD module, defaulting to SQLite, and which includes FTN Nodelist
    processing. See README and other documentation for more information.

    I will be using that Perl module (which is also hosted to CPAN) for Nodelist processing, for loading the nodelists in to the SQLite database for further processing there. I'll also be generating reports using it, which I'll be posting in various ways...



    Jame

    --- BBBS/LiI v4.01 Flag
    # Origin: Rocasa BBS (1:120/546)
    # Origin: LiveWire BBS -=*=- telnet://livewirebbs.com (1:2320/100)
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Jame Clay@1:2320/100 to All on Thu Apr 14 12:53:02 2011
    All,

    File: ftnpldb.zip (14kB), Area: PERLMOD, Origin: 1:120/546
    Desc: FTN-Database modules and associated scripts which can be used for Fidonet/FTN related processing in an SQL database supported by a Perl
    DBD module, defaulting to SQLite, and which includes FTN Nodelist
    processing. See README and other documentation for more information.

    I will be using that Perl module (which is also hosted at CPAN) for
    Nodelist processing, for loading the nodelists into an SQLite database for further processing there. I'll also be generating reports using it, which I'll be posting in various ways...


    Jame

    --- BBBS/LiI v4.01 Flag
    # Origin: Rocasa BBS (1:120/546)
    # Origin: LiveWire BBS -=*=- telnet://livewirebbs.com (1:2320/100)
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Benny Pedersen@1:2320/100 to Jame Clay on Tue Sep 20 11:50:02 2011
    Hello Jame!

    01 Oct 2010 17:58, Jame Clay wrote to All:

    I will be using that Perl module (which is also hosted to CPAN)
    for Nodelist processing, for loading the nodelists in to the SQLite database for further processing there.

    tryed to use this today under gentoo, with the fidonet overlay made by me, everything works :)

    I'll also be generating reports using it, which I'll be posting in
    various
    ways...

    i just miss one single thing now, nodelistDir load into db

    ----- ftnpldb.cfg begins -----
    LogFile=/opt/ftndb/ftnpldb.log

    [Database]
    Type=SQLite
    Name=ftndbtst

    [Nodelist]
    Directory=/opt/ftndb/nodelister
    ----- ftnpldb.cfg ends -----

    eq load all files from nodelister not just nodelist

    tryed "perl ftnpldb-nodelist -c ftnpldb.cfg -v load" with works ok, but only loads nodelist.day

    where do i extend this ?, calling ftnpldb-nodelist pr nodelist file ?


    Regards Benny

    ... there can only be one way of life, and it works :)

    --- Msged/LNX 6.2.0 (Linux/2.6.39-gentoo-r3 (i686))
    # Origin: home.junc.org where qico is waiting (2:230/0)
    # Origin: LiveWire BBS -=*=- telnet://livewirebbs.com (1:2320/100)
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Jame Clay@1:2320/100 to Benny Pedersen on Wed Sep 21 11:37:02 2011
    01 Oct 2010 17:58, Jame Clay wrote to All:
    I will be using that Perl module (which is also hosted to CPAN)
    for Nodelist processing, for loading the nodelists in to the SQLite
    database for further processing there.

    tryed to use this today under gentoo, with the fidonet overlay made by me, everything works :)

    Glad to hear it!


    i just miss one single thing now, nodelistDir load into db

    ----- ftnpldb.cfg begins -----
    ....
    ----- ftnpldb.cfg ends -----

    That looked fine...


    eq load all files from nodelister not just nodelist

    If they are same type of nodelist, the current code will try to load the most recent. If there are different nodelists there, like Fidonet (nodelist.???) and Linuxnet (linuxnet.???), then it needs to be called separately for each type.


    tryed "perl ftnpldb-nodelist -c ftnpldb.cfg -v load" with works ok, but only loads nodelist.day

    What other nodelist files are actually present?


    where do i extend this ?, calling ftnpldb-nodelist pr nodelist file ?

    If they are different domains, then yes. I have 5 FTN nodelists for the 5 different domains I'm in. For something like FamilyNet, for instance, the command line I use is like this:

    ftnpldb-nodelist -c $CFGFILE -f fmlylist -d fmlynet -v load


    Now, if what you want to do is load multiple nodelists of the same type or domain, that is not yet in the code but is where I'm doing with it. The way it is now, only the (presumably) most recent nodelist for a particular domain is kept in the database. Where I'm going with the code; that use case (only 1 nodelist of a particular domain in the database) will still be possible but it will also be possible to load multiple nodelists of the same domain into the database. So one could load a couple (or a set) of nodelists for the same domain, perhaps for comparison purposes. (And/or for a web app where one could look up info for any nodelist...)

    I have started on that but the changes have not yet been pushed to the public respositories and are certainly not far enough along to put on CPAN as yet or to hatch out in the PERL File echo...



    Jame

    --- BBBS/LiI v4.01 Flag
    # Origin: Rocasa BBS (1:120/546)
    # Origin: LiveWire BBS -=*=- telnet://livewirebbs.com (1:2320/100)
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)