Kuro http pages for debian

This is an early work in progress ! Still a lot of work to make this complete !

Introduction

You may know the Kuro-box HTTP interface that allow to manage many things like samba shares and many other things ! As I love these pages, I decided to make them running with Debian !

Progress

Legend :
(P) = ported thing : It was existing before, but needed some modifications in CGI code or system files
(N) = new feature : It's something new in the interface.
(B) = bug fix : There are some bugs in the administartion pages/scripts, it's better to correct them !

Things done

• (P) Porting main http structure
• (P) IP set to 192.168.11.150 if no DHCP server found (and configured to run in DHCP)
• (P) NTP synchronisation at startup if enabled (needs ntp and ntpdate)
• (P) NTP cron job at a defined hour if enabled (needs cron)
• (P) Network link stats in status page (need ethtool)
• (N) HDD temperature information (need hddtemp)
• (P) Samba users management (need samba)
• (B) There is an anoying bug about the workgroup setup not working => Using my scripts, i don't have this bug ...
• (P) Samba shares handling

Things to do, or not yet finished

• (P) USB drive handling (need udev & usbmount)
• (P) AppleTalk management
• (P) FTP management
• (P) Automatic backup
• (P) Kurobox sleep
• (P) USB printer sharing
• (N) Add a reboot menu
• (N) Add some server applications configuration pages (including mt-daapd, amule ...)

Things that people would like to have

Feel free to add anything here (with no garantee it will be added)

• Jukebox to play music on your Kuro
• Wizd and configuration editor
• uShare uPnP media server

Needed packages

For now, these packages are needed :

apt-get install hddtemp ntp ntpdate ethtool cron udev usbmount samba nkf proftpd

Needed files

These files are needed for the http pages to work :

/etc/melco/*
/etc/atalk/
/etc/init.d/networking
/etc/init.d/ntpdate
/etc/init.d/mkshinfo
/etc/init.d/chkshare
/etc/cron.daily/ntpdate
/etc/timezone
/etc/linkstation_release
/etc/rc2.d/S10ntpdate (ln -s ../init.d/ntpdate S10ntpdate)
/etc/rcS.d/S48mkshinfo (ln -s ../init.d/mkshinfo S48mkshinfo)
/var/www/cgi-bin/*
/var/www/image/*
/var/www/help/*
/var/www/errors/*
/bin/mkcode
/bin/chk_ip
/sbin/mkshinfo
/usr/bin/parse_usbscsi
/etc/usbmount/usbmount.conf
/etc/usbmount/mount.d/01_update_mnt2_usbinfo_files (ln -s /usr/bin/parse_usbscsi 01_update_mnt2_usbinfo_files)
/etc/usbmount/umount.d/01_update_mnt2_usbinfo_files (ln -s /usr/bin/parse_usbscsi 01_update_mnt2_usbinfo_files)
/bin/ifconfig (ln -s /sbin/ifconfig ifconfig)
/etc/init.d/ftpd

For preliminar wlan support :

/usr/sbin/setmacfilter.sh
...

Scripts to write

There is some applications from melco that are written in C, and we have no access to source ! Some scripts need to be rewritten as they can't work anymore in a 2.6 kernel, or because some applications are not working the same way than before !

mkcode

Known actions

mkcode application is the application that create some configuration files for Samba, Netatalk and xxFTPD

> mkcode
Samba/Netatalk/xxFTPD configuration file generetor: mkcode 1.20/ppc, May 16 2005
for HD-HGLAN(BUFFALO INC.), uses sjis
usage: mkcode options[-s/-a/-f].

It uses the configuration file /etc/melco/shareinfo /etc/melco/shareinfo file looks like that :

share<>all<>all<>Win/Mac<>777<>777<>KURO-BOX Share Folder<>0<>0;
music<>all<>all<>Win/Mac<>777<>777<>KURO-BOX Share Folder<>0<>0;

The template is :

directory name<>users list<>groups list<>OS support<>create mode<>directory mode<>Shared Folder Description<>Folder attribute<>Recycler bin;

with

users list = (empty) : no user can access this share
             all : all users can access this share
             user1 : only user1 can access this share
             user1,user2,... : list of users that can access this share
groups list = (empty) : no groups can access this share
              all : all groups can access this share
              @group1 : all users of group1 can access this share
              @group1,@group2,@... : all users of listed groups can access this share
OS support = Win : Windows Support (aka Samba)
             Mac : MacOS Support (aka Appletalk)
             Win/Mac : Both OS support (Samba & Appletalk)
create mode &
directory mode = 777 : Created files and directories are created with 777 mode (all users can access the files from telnet/ssh)
Folder attributes = 0 : Read/Write
                    1 : Read only
                    2 : Not shared (new feature)
Recycler bin = 0 : disabled
               1 : enabled

Samba configuration file

When calling mkcode -s, mkcode check every entries in /etc/melco/shareinfo and create a /etc/samba/smb.conf file with these sections :

[global]

to be completed

[global]
    client code page = 850
    character set = ISO8859-1
    workgroup = WORKGROUP
    server string = Kuro-Box
    socket options = TCP_NODELAY SO_SNDBUF=12288 SO_RCVBUF=12288
    dns proxy = No
    netbios name = KURO-BOX
    os level = 1
    wins server = 

    security = user
    encrypt passwords = Yes
    obey pam restrictions = Yes
    pam password change = Yes
    passwd program = /usr/bin/passwd %u
    passwd chat = *New*password* %n\n *Retype*new*password* %n\n *passwd:*all*authentication*tokens*updated*successfully*
    unix password sync = yes
    guest account = nobody
    null passwords = yes
    guest only = no
    username level = 12
    password level = 8
    map to guest = Bad User

    browsable = no
    preserve case = yes
    short preserve case = yes
    veto files = /.AppleDesktop/Network Trash Folder/TheVolumeSettingsFolder/.AppleDouble/.AppleDB/
    delete veto files = yes

    invalid users = mail, deamon, adt
    admin users = root
    username map = /etc/samba/smbusers
    
    getwd cache = yes
    printcap name = /etc/printcap
    load printers = yes
    printing = lprng

[lp]

It's the section for printer sharing

[lp]
    comment = Network Printer for Windows
    path = /mnt/spool/samba
    print command = /usr/bin/lpr -Plp -r %s
    printer admin = root
    browsable = yes
    printable = yes
    public = yes

Shared folders sections

Then we have a section per shared folders (list is in /etc/melco/shareinfo) :

[shared_folder]
    comment = comment from /etc/melco/shareinfo
    path = path of the directory (/mnt/shared_folder)
    browsable = yes
    printable = no
    writable = yes (if Folder attributes = 0)/no (if Folder attributes = 1)

if sharing is restricted to some users/groups, then we have that line :

    valid users = user1,user2, @group1,@group2

    force create mode = 777
    force directory mode = 777

if recycler is enabled (Recycler bin = 1), we have these lines :

    vfs object = /usr/lib/samba/recycle.so
    vfs options = /etc/samba/recycle.conf 

Changes because of Samba v3.x.x

HTTP pages were using Samba v2.x.x, but as we're using Samba v3.x.x, we have to update some little things :

The way users are stored

With Samba 2.x.x, we were using smbpasswd to create samba's users, with Samba v3.x.x, we have to use pdbedit

The way the recycler works

Configuration is different, we have to set something like that in the share's section :

vfs object = recycle
        recycle:repository = .trash/
        recycle:keeptree = Yes
        recycle:touch = Yes
        recycle:versions = Yes
        recycle:maxsixe = 0
        recycle:exclude = *.tmp
        recycle:exclude_dir = /tmp
        recycle:noversions = *.doc

Perl script

Warning : it's still a work in progress script even if it allows to generate samba configuration file !

#!/usr/bin/perl
#use strict;

# This script replace original /bin/mkcode application by melco
# History :
# 06/07/19 by sylver : creation

my $fileMELSHARE,$fileMELINFO,$fileMELPRINTER,$fileSMB;
my $localWorkgroup;
my @localTemp;

#input files
$fileMELSHARE="/etc/melco/shareinfo";
$fileMELINFO="/etc/melco/info";
$fileMELPRINTER="/etc/melco/printer";
$fileFTPSTATUS="/etc/melco/ftpstatus";
$fileHOSTS="/etc/hosts";
$fileMTAB="/etc/mtab";

#output files
$fileSMB="/etc/samba/smb.conf";
$fileATALKVOLUMES="/etc/atalk/AppleVolumes.default";
$fileATALKCONFIG="/etc/atalk/config.papd";
$fileFTP="/etc/wu-ftpd/ftpaccess";

print "Samba/Netatalk/xxFTPD configuration file generator: mkcode 0.1 by sylver\n\n";
if ($#ARGV != 0)
  {
  print "usage: mkcode options[-s/-a/-f].";
  exit(0);
  }

#Someone asked to build the samba config file
if ($ARGV[0] eq "-s")
  {
  # building [global] section
  push (@SMB,"[global]\n");
  $localWorkgroup = readpipe("grep \"^wg=\" $fileMELINFO 2> /dev/null");
  chomp $localWorkgroup;
  @localTemp = split /=/, $localWorkgroup;
  push (@SMB,"    workgroup = ".@localTemp[1]."\n");
  push (@SMB,"    server string = %h server (Samba %v)\n"); # TODO : get the correct string
  push (@SMB,"    socket options = TCP_NODELAY SO_SNDBUF=8192 SO_RCVBUF=8192\n"); # TODO : check when to set to TCP_NODELAY SO_SNDBUF=32768 SO_RCVBUF=32768
  push (@SMB,"    dns proxy = No\n");

  $localHostName = readpipe("hostname");
  @localTemp = split /\./, $localHostName;
  $localHostName = $localTemp[0];
  chomp $localHostName;
  push (@SMB,"    netbios name = $localHostName\n");
  push (@SMB,"    os level = 1\n");
  $localWins = readpipe("grep \"^wins=\" $fileMELINFO 2> /dev/null");
  chomp $localWins;
  @localTemp = split /=/, $localWins;
  push (@SMB,"    wins server = ".$localTemp[1]."\n");
  push (@SMB,"\n");
  push (@SMB,"    security = user\n");
  push (@SMB,"    encrypt passwords = true\n");
  push (@SMB,"    passdb backend = tdbsam\n");
  push (@SMB,"    obey pam restrictions = Yes\n");
  push (@SMB,"    pam password change = Yes\n");
  push (@SMB,"    invalid users = root\n");
  push (@SMB,"    passwd program = /usr/bin/passwd %u\n");
  push (@SMB,"    passwd chat = *New*password* %n\\n *Retype*new*password* %n\\n *passwd:*all*authentication*tokens*updated*successfully*\n");
  push (@SMB,"    unix password sync = yes\n");
  push (@SMB,"    guest account = nobody\n");
  push (@SMB,"    null passwords = yes\n");
  push (@SMB,"    guest only = no\n");
  push (@SMB,"    username level = 12\n");
  push (@SMB,"    password level = 8\n");
  push (@SMB,"    map to guest = Bad User\n");
  push (@SMB,"\n");
  push (@SMB,"    browsable = no\n");
  push (@SMB,"    preserve case = yes\n");
  push (@SMB,"    short preserve case = yes\n");
  push (@SMB,"    veto files = /.AppleDesktop/Network Trash Folder/TheVolumeSettingsFolder/.AppleDouble/.AppleDB/\n");
  push (@SMB,"    delete veto files = yes\n");
  push (@SMB,"\n");
  push (@SMB,"    invalid users = mail, deamon, adt\n");
  push (@SMB,"    admin users = root\n");
  push (@SMB,"    username map = /etc/samba/smbusers\n");
  push (@SMB,"    getwd cache = yes\n");
  push (@SMB,"\n");

  #building printer section
  $localPrinter = readpipe("grep \"^printer=\" $fileMELPRINTER 2> /dev/null");
  chomp $localPrinter;
  @localTemp = split /=/, $localPrinter;
  if($localTemp[1] eq "on")
    {
    push (@SMB,"    printcap name = /etc/printcap\n");
    push (@SMB,"    load printers = yes\n");
    push (@SMB,"    printing = lprng\n");
    push (@SMB,"\n");
    }
  push (@SMB,"    include = /etc/samba/smb.conf.kuro\n");

  # Building shares sections
  # Template of MELSHARE file :
  # directory name<>users list<>groups list<>OS support<>create mode<>directory mode<>Shared Folder Description<>Folder attribute<>Recycler bin;
  #       0              1            2           3           4               5                   6                      7               8
  open (FILE, "$fileMELSHARE" );
  foreach $LINE (<FILE>)
      {
      chomp $LINE;
      @localTemp = split /<>/, $LINE;
      # If folder attribute = 2, then don't share the folder !
      if ($localTemp[7] != 2)
        {
        push (@SMB,"[".$localTemp[0]."]\n");
        push (@SMB,"    comment = ".$localTemp[6]."\n");
        push (@SMB,"    path = /mnt/".$localTemp[0]."\n");
        push (@SMB,"    browsable = yes\n");
        push (@SMB,"    printable = no\n");
        push (@SMB,"    writable = ");
        if ($localTemp[7] == 0)
          {
          push (@SMB,"yes\n");
          }
        else
          {
          push (@SMB,"no\n");
          }

        if (($localTemp[1] eq "all") || ($localTemp[2] eq "all"))
          {
          push (@SMB,"    guest ok = yes\n");
          }
        else
          {
          push (@SMB,"    valid users = ".$localTemp[1].",".$localTemp[2]."\n");
          }
        push (@SMB,"    force create mode = ".$localTemp[4]."\n");
        push (@SMB,"    force directory mode = ".$localTemp[5]."\n");
        if ($localTemp[8] == 1)
          {
          push (@SMB,"    vfs object = recycle\n");
          push (@SMB,"            recycle:repository = .trash/\n");
          push (@SMB,"            recycle:keeptree = Yes\n");
          push (@SMB,"            recycle:touch = Yes\n");
          push (@SMB,"            recycle:versions = Yes\n");
          push (@SMB,"            recycle:maxsixe = 0\n");
          push (@SMB,"            recycle:exclude = *.tmp\n");
          push (@SMB,"            recycle:exclude_dir = /tmp\n");
          push (@SMB,"            recycle:noversions = *.doc\n");
          }
        push (@SMB,"###".$localTemp[0]."###\n");
        }
      }

  close(FILE);

  #
  # USB and CD/DVD drives sharing
  #

  $localUSBSHARE = readpipe("grep \"^usbdisk=\" $fileMELINFO 2> /dev/null");
  chomp $localUSBSHARE;
  @localTemp = split /=/, $localUSBSHARE;
  if($localTemp[1] eq "on")
    {
    $cpt_usb=1;
    $cpt_cd=1;
    open (FILE, $fileMTAB );
    foreach $LINE (<FILE>)
      {
      $localUSB = readpipe("echo \"$LINE\" | grep \"\/mnt2\/\" 2> /dev/null");
      if ($localUSB)
        {
        chomp $localUSB;
        @localUSB = split / /, $localUSB;
        @localTemp = split /\//, $localUSB[1];
        push (@SMB,"[".$localTemp[2]."]\n");
        if ($localTemp[2] eq "cdrom")
          {
          push (@SMB,"    comment = CD-ROM ".$cpt_cd."\n");
          $cpt_cd++;
          }
        else
          {
          push (@SMB,"    comment = USB HDD ".$cpt_usb."\n");
          $cpt_usb++;
          }
        push (@SMB,"    path = ".$localUSB[1]."\n");
        push (@SMB,"    browsable = yes\n");
        push (@SMB,"    writable = yes\n");
        push (@SMB,"    printable = no\n");
        push (@SMB,"    guest ok = yes\n");
        push (@SMB,"    force create mode = 777\n");
        push (@SMB,"    force directory mode = 777\n");
        push (@SMB,"###".$localTemp[2]."###\n");
        }
      }
    close(FILE);
    }

  push (@SMB,"#####END#####\n");

  open (FILE,">$fileSMB");
  print FILE @SMB ;
  close(FILE);
  print "done.\n";
  }

#Someone asked to build the AppleTalk config file
if ($ARGV[0] eq "-a")
  {
  print "Appletalk configuration not yet implemented"
#  print "done.";
  }

#Someone asked to build the FTP config file
if ($ARGV[0] eq "-f")
  {
  print "FTP configuration not yet implemented"
#  print "done.";
  }

Things to improve

Done :

• You can now tell that you don't want to share a folder in /mnt !

mkshinfo

Known actions

Check folders in /mnt and add unconfigured folders in /etc/melco/shareinfo. Check /etc/melco/shareinfo and creates unexisting shares in /mnt. The original application was sharing folders that where not already in the shareinfo file, but now that we can tell not to share a folder, if the folder have been created by hand, we can consider that we don't want to share it !

Perl script

#!/usr/bin/perl
#use strict;

# This script replace original /sbin/mkshinfo application by melco
# History :
# 06/07/19 by sylver : creation

# First step is to parse the shareinfo file to check if every directory exists. If it doesn't exist, then create it in /mnt
# Second step is to parse the /mnt and to add a default configuration in shareinfo file for directories that are not already in it 

#input files
$fileMELSHARE="/etc/melco/shareinfo";

# Template of MELSHARE file :
# directory name<>users list<>groups list<>OS support<>create mode<>directory mode<>Shared Folder Description<>Folder attribute<>Recycler bin;
#       0              1            2           3           4               5                   6                      7               8

#
# Check for some missing /mnt directories
#
open (FILE, "$fileMELSHARE" );
foreach $LINE (<FILE>)
    {
    chomp $LINE;
    @localTemp = split /<>/, $LINE;
    # if the directory is different from "none" and doesn't exist, then create it
    if (($localTemp[0] ne "none")&&(! -d "/mnt/$localTemp[0]"))
      {
      system ("mkdir -p /mnt/$localTemp[0] > /dev/null 2>&1");
      chmod 0777 ,"/mnt/$localTemp[0]";
      }
    }
close(FILE);

#
# Check for some missing configuration in shareinfo file
#

# Mark the shareinfo file as not beeing blank
$shareBlank = 0;

@files_found = </mnt/*>;
for($file=0;$file<@files_found;$file++)
  {
  if ( -d $files_found[$file])
    {
    # Extract the directory name
    @shareName = split /\//, $files_found[$file];

    #
    # Parse shareinfo to find if it's already configured
    #
    # Template of MELSHARE file :
    # directory name<>users list<>groups list<>OS support<>create mode<>directory mode<>Shared Folder Description<>Folder attribute<>Recycler bin;
    #       0              1            2           3           4               5                   6                      7               8
    $shareFound = 0;
    open (FILE, "$fileMELSHARE" );
    foreach $LINE (<FILE>)
      {
      chomp $LINE;
      @localTemp = split /<>/, $LINE;
      if ($localTemp[0] eq "none")
        {
        # the file is blank, remember that to rewrite it instead of append !
        $shareBlank = 1;
        }
      if ( $localTemp[0] eq $shareName[2])
        {
        $shareFound = 1;
        }
      }
    close (FILE);
    if ($shareFound == 0)
      {
      chmod 0777 ,"/mnt/$shareName[2]";
      push (@SHAREINFO,"$shareName[2]<>all<>all<>Win/Mac<>777<>777<>KURO-BOX Share Folder<>2<>0;\n");
      }
    }
  }

#
# If there are some new folders, add them in shareinfo file
#
if (@SHAREINFO)
  {
  if ($shareBlank == 1)
    {
    # Open to write
    open (FILE, ">$fileMELSHARE");
    }
  else
    {
    # Open to append
    open (FILE, ">>$fileMELSHARE");
    }
  print FILE @SHAREINFO;
  close (FILE);
  }

chk_ip

Known actions

It checks that the given IP address and subnet address are correct (it's called when you want to fix kurobox's IP) :

> chk_ip ip_address subnet_address

Forbidden IP address :

• 0.0.0.0 (network address)

IP address is network address!

• 127.0.0.1 (loopback)

IP address is reserved!

• 255.255.255.255 (broadcast)

IP address is broadcast address!

• class D addresses : 224.0.0.0 to 239.255.255.255

IP address is Class D

• class E addresses : 240.0.0.0 to 255.255.255.254

IP address is Class E

• If submask address is 255.255.255.255

IP address is broadcast address!

• If address and submask are ok :

IP address and sub netmask is correct

Perl script

#!/usr/bin/perl
#use strict;

# This script replace original /bin/chk_ip application by melco
# History :
# 06/07/19 by sylver : creation

if ($#ARGV != 1)
  {
  print "usage: chk_ip xxx.xxx.xxx.xxx xxx.xxx.xxx.xxx\n";
  exit(1);
  }

if ($ARGV[0] eq "0.0.0.0")
  {
  print "IP address is network address!\n";
  exit(1);
  }

if ($ARGV[0] eq "127.0.0.1")
  {
  print "IP address is reserved!\n";
  exit(1);
  }

if (($ARGV[0] eq "255.255.255.255")||($ARGV[1] eq "255.255.255.255"))
  {
  print "IP address is broadcast address!\n";
  exit(1);
  }

# Get first IP value to check address class
@localTemp = split /\./, $ARGV[0];
if (($localTemp[0] >= 224) && ($localTemp[0] < 240))
  {
  print "IP address is Class D\n";
  exit(1);
  } 

if ($localTemp[0] >= 240)
  {
  print "IP address is Class E\n";
  exit(1);
  }

print "IP address and sub netmask are correct\n";
exit(0);

parse_usbscsi

Known actions

It's parsing /proc/scsi/usb-storage-*/* to find supported devices and fills to files with some information :

• /mnt2/usbinfo/list that contains a list of /dev/sd? devices plugged. For example :

> cat /mnt2/usbinfo/list
/dev/sda
/dev/sdc

• /mnt2/usbinfo/exist that contains several informations separated by ',' :

> cat /mnt2/usbinfo/exist
/dev/sda,00JB-55GVA0     ,HDD 
/dev/sdc,HA250JC         ,HDD

Original parse_usbscsi only supports devices tagged in /proc/scsi/scsi as "Type:" equal to

• Direct-Access
• Optical Device
• Optical-Device
• HardDisk
• Hard Disk

There are 2 problems :

• In 2.6 kernel, USB devices are stored in /proc/scsi/usb-storage/* (0,1,2 ...)
• Limiting support for listed types will prevent most of the USB thumbdrives to work

We will correct these 2 problems with our script ;)

Perl script

This script is not working well, and it's not written in the best way (it's calling 'awk' command but this part should be rewritten in PERL by someone who knows PERL better than me). For now the /mnt2/usbinfo/exist output is wrong but it seems to work that way. I'll correct that later. The main problem is that the content of the files is not exact all the time. Need some work to see how to make things correct !

#!/usr/bin/perl
#use strict;

# This script replace original /usr/bin/parse_usbscsi application by melco
# History :
# 06/07/19 by sylver : creation

# if running a 2.4.x kernel
# use /proc/scsi/usb-storage-*/*
# else (2.6.x kernel)
# use /proc/scsi/usb-storage/*

$localKernel24 = readpipe("uname -r | grep \"2.4.\" 2> /dev/null");
if ($localKernel24)
  {
  $localSCSIFiles = "/proc/scsi/usb-storage-*/*";
  }
else
  {
  $localSCSIFiles = "/proc/scsi/usb-storage/*";
  }

# fill /mnt2/usbinfo/exist :
# run awk '$1 ~ /Host/ && $3 ~ /usb-storage/ {printf "/dev/sd%c,", substr($2, 5, length($2) - 5) + 97}' $localSCSIFiles >/mnt2/usbinfo/exist
# This command is based on "nix" work (from linkstationwiki). It should be converted to perl.
system("awk '\$1 ~ /Host/ && \$3 ~ /usb-storage/ {printf \"/dev/sd%c,\", substr(\$2, 5, length(\$2) - 5) + 97}' $localSCSIFiles >/mnt2/usbinfo/exist");

# fill /mnt2/usbinfo/list :
# run awk '$1 ~ /Host/ && $3 ~ /usb-storage/ {printf "/dev/sd%c\n", substr($2, 5, length($2) - 5) + 97}' $localSCSIFiles >/mnt2/usbinfo/list
# This command is based on "nix" work (from linkstationwiki). It should be converted to perl.
system("awk '\$1 ~ /Host/ && \$3 ~ /usb-storage/ {printf \"/dev/sd%c\\n\", substr(\$2, 5, length(\$2) - 5) + 97}' $localSCSIFiles >/mnt2/usbinfo/list");

exit (0);

Links

There are some usefull things to read there :

• http://www.linkstationwiki.net/index.php?title=Articles/GeneralMoreUSBDevices
• http://forum.linkstationwiki.net/index.php?action=vthread&forum=7&topic=945
• http://forum.linkstationwiki.net/index.php?action=vthread&forum=2&topic=315&page=0#msg1940