OpenWrt Forum Archive

Topic: Whiterussian rc3 bug? NVRAM intermittent Bus Error

The content of this topic has been archived on 3 Mar 2018. There are no obvious gaps in this topic, but there may still be some posts missing at the end.

Hello,

I've spent quite a bit of time trying to track down an issue where my WRT GS v1.1's and v2.0's intermittently are unreachable over ethernet after powering up (but from the LED's, the startup scripts obviously complete).  Power cycling a few times eventually brings them back.  This occurs both with my own build of Whiterussian rc1, and with the pre-built Whiterussian rc3 squashfs image on the OpenWRT website (tried the pre-built image to rule out that it was a bad build when I built rc1 myself).  Interestingly enough, this occurs on roughly 40% of all the GS v1.1's and v2.0's I've tried (about two dozen total), and loading the Linksys firmware back on them shows that the Linksys firmware does not exhibit the problem, only OpenWRT.  Generally on WRT's that do exhibit the problem, the problem shows up 100% of the time on the first power-up, and usually persists through a few more power cycles, then when it finally starts working, it continues working after power cycles until the WRT has been sitting for a few minutes powered off, then it's back to square one.  I've already ruled out temperature, faulty wall warts, power anomalies, chaos, mayhem, etc..

I played with a GS v1.1 tonight that was exhibiting the problem.  To figure it out, I inserted a script as S98blah in /etc/init.d to append a bunch of info (dmesg, nvram show, robocfg, ifconfig, bunch of /proc stuff) to /blah.log.  The script is below, as well as the output from a normal startup where everything works properly, followed by the output from a faulty startup where the WRT is unreachable via ethernet.  Note that on the faulty startup, "nvram show" yields no output and throws the "Bus Error" fault.  It's apparent the reason the WRT is then unreachable over ethernet is the network NVRAM variables are unavailable and the ethernet interface and VLAN settings are never brought up.

First, the script I'm using to log what happens on each boot (/etc/init.d/S98blah):

#!/bin/sh

echo ------------------------------------------------------------- >> /blah.log
echo Startup: >> /blah.log
echo >> /blah.log

echo dmesg: >> /blah.log
dmesg >> /blah.log
echo >> /blah.log

echo Logs: >> /blah.log
logread >> /blah.log
echo >> /blah.log

echo ifconfig: >> /blah.log
ifconfig >> /blah.log
echo >> /blah.log

echo robocfg show: >> /blah.log
robocfg show >> /blah.log
echo >> /blah.log

echo NVRAM variables: >> /blah.log
nvram show > /tmp/nvram1.log 2> /tmp/nvram2.log
sort < /tmp/nvram1.log >> /blah.log
cat /tmp/nvram2.log >> /blah.log
echo >> /blah.log

echo Environment: >> /blah.log
env >> /blah.log
echo >> /blah.log

echo ps aux: >> /blah.log
ps aux >> /blah.log
echo >> /blah.log

echo /proc/net/dev: >> /blah.log
cat /proc/net/dev >> /blah.log
echo >> /blah.log

echo /proc/net/vlan/config: >> /blah.log
cat /proc/net/vlan/config >> /blah.log
echo >> /blah.log

echo /proc/mtd: >> /blah.log
cat /proc/mtd >> /blah.log
echo >> /blah.log

echo /proc/cpuinfo: >> /blah.log
cat /proc/cpuinfo >> /blah.log
echo >> /blah.log

echo /proc/meminfo: >> /blah.log
cat /proc/meminfo >> /blah.log
echo >> /blah.log

echo /proc/cmdline: >> /blah.log
cat /proc/cmdline >> /blah.log
echo >> /blah.log

echo /proc/devices: >> /blah.log
cat /proc/devices >> /blah.log
echo >> /blah.log

echo /proc/modules: >> /blah.log
cat /proc/modules >> /blah.log
echo >> /blah.log

echo /proc/interrupts: >> /blah.log
cat /proc/interrupts >> /blah.log
echo >> /blah.log

echo >> /blah.log

# End

Here's what ends up in blah.log on a *normal* startup where everything works properly and the NVRAM variables are readable:

-------------------------------------------------------------
Startup:

dmesg:
CPU revision is: 00029007
Primary instruction cache 8kB, physically tagged, 2-way, linesize 16 bytes.
Primary data cache 4kB, 2-way, linesize 16 bytes.
Linux version 2.4.30 (wbx@ux-2y01) (gcc version 3.4.4) #1 Wed Sep 14 17:49:26 CEST 2005
Setting the PFC value as 0x15
Determined physical RAM map:
memory: 02000000 @ 00000000 (usable)
On node 0 totalpages: 8192
zone(0): 8192 pages.
zone(1): 0 pages.
zone(2): 0 pages.
Kernel command line: root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200
CPU: BCM4712 rev 1 at 200 MHz
Using 100.000 MHz high precision timer.
Calibrating delay loop... 199.47 BogoMIPS
Memory: 30504k/32768k available (1390k kernel code, 2264k reserved, 100k data, 80k init, 0k highmem)
Dentry cache hash table entries: 4096 (order: 3, 32768 bytes)
Inode cache hash table entries: 2048 (order: 2, 16384 bytes)
Mount cache hash table entries: 512 (order: 0, 4096 bytes)
Buffer cache hash table entries: 1024 (order: 0, 4096 bytes)
Page-cache hash table entries: 8192 (order: 3, 32768 bytes)
Checking for 'wait' instruction...  unavailable.
POSIX conformance testing by UNIFIX
PCI: Disabled
PCI: Fixing up bus 0
Linux NET4.0 for Linux 2.4
Based upon Swansea University Computer Society NET3.039
Initializing RT netlink socket
Starting kswapd
devfs: v1.12c (20020818) Richard Gooch (rgooch@atnf.csiro.au)
devfs: boot_options: 0x1
JFFS2 version 2.1. (C) 2001 Red Hat, Inc., designed by Axis Communications AB.
Squashfs 2.1-r2 (released 2004/12/15) (C) 2002-2004 Phillip Lougher
pty: 256 Unix98 ptys configured
Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
ttyS00 at 0xb8000300 (irq = 3) is a 16550A
ttyS01 at 0xb8000400 (irq = 0) is a 16550A
Software Watchdog Timer: 0.05, timer margin: 60 sec
Physically mapped flash: Found an alias at 0x800000 for the chip at 0x0
Physically mapped flash: Found an alias at 0x1000000 for the chip at 0x0
Physically mapped flash: Found an alias at 0x1800000 for the chip at 0x0
cfi_cmdset_0001: Erase suspend on write enabled
0: offset=0x0,size=0x20000,blocks=64
Using buffer write method
Flash device: 0x800000 at 0x1c000000
Creating 5 MTD partitions on "Physically mapped flash":
0x00000000-0x00040000 : "pmon"
0x00040000-0x007e0000 : "linux"
0x000ba4b0-0x001c0000 : "rootfs"
mtd: partition "rootfs" doesn't start on an erase block boundary -- force read-only
0x007e0000-0x00800000 : "nvram"
0x001c0000-0x007e0000 : "OpenWrt"
Initializing Cryptographic API
NET4: Linux TCP/IP 1.0 for NET4.0
IP Protocols: ICMP, UDP, TCP, IGMP
IP: routing cache hash table of 512 buckets, 4Kbytes
TCP: Hash tables configured (established 2048 bind 4096)
ip_conntrack version 2.1 (5953 buckets, 5953 max) - 320 bytes per conntrack
ip_tables: (C) 2000-2002 Netfilter core team
NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
NET4: Ethernet Bridge 008 for NET4.0
802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
VFS: Mounted root (squashfs filesystem) readonly.
Mounted devfs on /dev
Freeing unused kernel memory: 80k freed
Algorithmics/MIPS FPU Emulator v1.5
diag boardtype: 00000708
jffs2.bbc: SIZE compression mode activated.
PCI: Setting latency timer of device 00:02.0 to 64
eth0: Broadcom BCM47xx 10/100 Mbps Ethernet Controller 3.90.23.0
PCI: Setting latency timer of device 00:01.0 to 64
eth1: Broadcom BCM4320 802.11 Wireless Controller 3.90.37.0
device eth0 entered promiscuous mode
vlan0: add 01:00:5e:00:00:01 mcast address to master interface
device eth1 entered promiscuous mode
br0: port 2(eth1) entering learning state
br0: port 1(vlan0) entering learning state
br0: port 2(eth1) entering forwarding state
br0: topology change detected, propagating
br0: port 1(vlan0) entering forwarding state
br0: topology change detected, propagating
vlan1: add 01:00:5e:00:00:01 mcast address to master interface

Logs:
Jan  1 00:00:14 (none) syslog.info syslogd started: BusyBox v1.00 (2005.09.14-15:55+0000)
Jan  1 00:00:14 (none) kern.notice kernel: klogd started: BusyBox v1.00 (2005.09.14-15:55+0000)
Jan  1 00:00:14 (none) kern.warn kernel: CPU revision is: 00029007
Jan  1 00:00:14 (none) kern.warn kernel: Primary instruction cache 8kB, physically tagged, 2-way, linesize 16 bytes.
Jan  1 00:00:14 (none) kern.warn kernel: Primary data cache 4kB, 2-way, linesize 16 bytes.
Jan  1 00:00:14 (none) kern.warn kernel: Linux version 2.4.30 (wbx@ux-2y01) (gcc version 3.4.4) #1 Wed Sep 14 17:49:26 CEST 2005
Jan  1 00:00:14 (none) kern.warn kernel: Setting the PFC value as 0x15
Jan  1 00:00:14 (none) kern.warn kernel: Determined physical RAM map:
Jan  1 00:00:14 (none) kern.warn kernel:  memory: 02000000 @ 00000000 (usable)
Jan  1 00:00:14 (none) kern.warn kernel: On node 0 totalpages: 8192
Jan  1 00:00:14 (none) kern.warn kernel: zone(0): 8192 pages.
Jan  1 00:00:14 (none) kern.warn kernel: zone(1): 0 pages.
Jan  1 00:00:14 (none) kern.warn kernel: zone(2): 0 pages.
Jan  1 00:00:14 (none) kern.warn kernel: Kernel command line: root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200
Jan  1 00:00:14 (none) kern.warn kernel: CPU: BCM4712 rev 1 at 200 MHz
Jan  1 00:00:14 (none) kern.warn kernel: Using 100.000 MHz high precision timer.
Jan  1 00:00:14 (none) kern.warn kernel: Calibrating delay loop... 199.47 BogoMIPS
Jan  1 00:00:14 (none) kern.info kernel: Memory: 30504k/32768k available (1390k kernel code, 2264k reserved, 100k data, 80k init, 0k highmem)
Jan  1 00:00:14 (none) kern.info kernel: Dentry cache hash table entries: 4096 (order: 3, 32768 bytes)
Jan  1 00:00:14 (none) kern.info kernel: Inode cache hash table entries: 2048 (order: 2, 16384 bytes)
Jan  1 00:00:14 (none) kern.info kernel: Mount cache hash table entries: 512 (order: 0, 4096 bytes)
Jan  1 00:00:14 (none) kern.info kernel: Buffer cache hash table entries: 1024 (order: 0, 4096 bytes)
Jan  1 00:00:14 (none) kern.warn kernel: Page-cache hash table entries: 8192 (order: 3, 32768 bytes)
Jan  1 00:00:14 (none) kern.warn kernel: Checking for 'wait' instruction...  unavailable.
Jan  1 00:00:14 (none) kern.warn kernel: POSIX conformance testing by UNIFIX
Jan  1 00:00:14 (none) kern.warn kernel: PCI: Disabled
Jan  1 00:00:14 (none) kern.warn kernel: PCI: Fixing up bus 0
Jan  1 00:00:14 (none) kern.info kernel: Linux NET4.0 for Linux 2.4
Jan  1 00:00:14 (none) kern.info kernel: Based upon Swansea University Computer Society NET3.039
Jan  1 00:00:14 (none) kern.warn kernel: Initializing RT netlink socket
Jan  1 00:00:14 (none) kern.warn kernel: Starting kswapd
Jan  1 00:00:14 (none) kern.info kernel: devfs: v1.12c (20020818) Richard Gooch (rgooch@atnf.csiro.au)
Jan  1 00:00:14 (none) kern.info kernel: devfs: boot_options: 0x1
Jan  1 00:00:14 (none) kern.notice kernel: JFFS2 version 2.1. (C) 2001 Red Hat, Inc., designed by Axis Communications AB.
Jan  1 00:00:14 (none) kern.info kernel: Squashfs 2.1-r2 (released 2004/12/15) (C) 2002-2004 Phillip Lougher
Jan  1 00:00:14 (none) kern.warn kernel: pty: 256 Unix98 ptys configured
Jan  1 00:00:14 (none) kern.info kernel: Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
Jan  1 00:00:14 (none) kern.info kernel: ttyS00 at 0xb8000300 (irq = 3) is a 16550A
Jan  1 00:00:14 (none) kern.info kernel: ttyS01 at 0xb8000400 (irq = 0) is a 16550A
Jan  1 00:00:14 (none) kern.info kernel: Software Watchdog Timer: 0.05, timer margin: 60 sec
Jan  1 00:00:14 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x800000 for the chip at 0x0
Jan  1 00:00:14 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x1000000 for the chip at 0x0
Jan  1 00:00:14 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x1800000 for the chip at 0x0
Jan  1 00:00:14 (none) kern.notice kernel: cfi_cmdset_0001: Erase suspend on write enabled
Jan  1 00:00:14 (none) kern.debug kernel: 0: offset=0x0,size=0x20000,blocks=64
Jan  1 00:00:14 (none) kern.warn kernel: Using buffer write method
Jan  1 00:00:14 (none) kern.notice kernel: Flash device: 0x800000 at 0x1c000000
Jan  1 00:00:14 (none) kern.notice kernel: Creating 5 MTD partitions on "Physically mapped flash":
Jan  1 00:00:14 (none) kern.notice kernel: 0x00000000-0x00040000 : "pmon"
Jan  1 00:00:14 (none) kern.notice kernel: 0x00040000-0x007e0000 : "linux"
Jan  1 00:00:14 (none) kern.notice kernel: 0x000ba4b0-0x001c0000 : "rootfs"
Jan  1 00:00:14 (none) kern.warn kernel: mtd: partition "rootfs" doesn't start on an erase block boundary -- force read-only
Jan  1 00:00:14 (none) kern.notice kernel: 0x007e0000-0x00800000 : "nvram"
Jan  1 00:00:14 (none) kern.notice kernel: 0x001c0000-0x007e0000 : "OpenWrt"
Jan  1 00:00:14 (none) kern.info kernel: Initializing Cryptographic API
Jan  1 00:00:14 (none) kern.info kernel: NET4: Linux TCP/IP 1.0 for NET4.0
Jan  1 00:00:14 (none) kern.info kernel: IP Protocols: ICMP, UDP, TCP, IGMP
Jan  1 00:00:14 (none) kern.info kernel: IP: routing cache hash table of 512 buckets, 4Kbytes
Jan  1 00:00:14 (none) kern.info kernel: TCP: Hash tables configured (established 2048 bind 4096)
Jan  1 00:00:14 (none) kern.warn kernel: ip_conntrack version 2.1 (5953 buckets, 5953 max) - 320 bytes per conntrack
Jan  1 00:00:14 (none) kern.warn kernel: ip_tables: (C) 2000-2002 Netfilter core team
Jan  1 00:00:14 (none) kern.info kernel: NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
Jan  1 00:00:14 (none) kern.info kernel: NET4: Ethernet Bridge 008 for NET4.0
Jan  1 00:00:15 (none) kern.info kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
Jan  1 00:00:15 (none) kern.info kernel: All bugs added by David S. Miller <davem@redhat.com>
Jan  1 00:00:15 (none) kern.warn kernel: VFS: Mounted root (squashfs filesystem) readonly.
Jan  1 00:00:15 (none) kern.info kernel: Mounted devfs on /dev
Jan  1 00:00:15 (none) kern.info kernel: Freeing unused kernel memory: 80k freed
Jan  1 00:00:15 (none) kern.warn kernel: Algorithmics/MIPS FPU Emulator v1.5
Jan  1 00:00:15 (none) kern.info kernel: diag boardtype: 00000708
Jan  1 00:00:16 (none) kern.warn kernel: jffs2.bbc: SIZE compression mode activated.
Jan  1 00:00:16 (none) kern.debug kernel: PCI: Setting latency timer of device 00:02.0 to 64
Jan  1 00:00:16 (none) kern.warn kernel: eth0: Broadcom BCM47xx 10/100 Mbps Ethernet Controller 3.90.23.0
Jan  1 00:00:16 (none) user.info : Using /lib/modules/2.4.30/et.o
Jan  1 00:00:16 (none) user.info : Warning: loading et will taint the kernel: no license
Jan  1 00:00:16 (none) user.info :   See http://www.tux.org/lkml/#export-tainted for information about tainted modules
Jan  1 00:00:17 (none) kern.debug kernel: PCI: Setting latency timer of device 00:01.0 to 64
Jan  1 00:00:17 (none) kern.warn kernel: eth1: Broadcom BCM4320 802.11 Wireless Controller 3.90.37.0
Jan  1 00:00:17 (none) user.info : Using /lib/modules/2.4.30/wl.o
Jan  1 00:00:17 (none) user.info : Warning: loading wl will taint the kernel: no license
Jan  1 00:00:17 (none) user.info :   See http://www.tux.org/lkml/#export-tainted for information about tainted modules
Jan  1 00:00:17 (none) user.info : Using /lib/modules/2.4.30/wlcompat.o
Jan  1 00:00:18 (none) kern.info kernel: device eth0 entered promiscuous mode
Jan  1 00:00:19 (none) kern.debug kernel: vlan0: add 01:00:5e:00:00:01 mcast address to master interface
Jan  1 00:00:19 (none) kern.info kernel: device eth1 entered promiscuous mode
Jan  1 00:00:19 (none) kern.info kernel: br0: port 2(eth1) entering learning state
Jan  1 00:00:19 (none) kern.info kernel: br0: port 1(vlan0) entering learning state
Jan  1 00:00:19 (none) kern.info kernel: br0: port 2(eth1) entering forwarding state
Jan  1 00:00:19 (none) kern.info kernel: br0: topology change detected, propagating
Jan  1 00:00:19 (none) kern.info kernel: br0: port 1(vlan0) entering forwarding state
Jan  1 00:00:19 (none) kern.info kernel: br0: topology change detected, propagating
Jan  1 00:00:21 (none) user.info : cat: /var/run/vlan1.pid: No such file or directory
Jan  1 00:00:21 (none) user.info : info, udhcpc (v0.9.9-pre) started
Jan  1 00:00:21 (none) kern.debug kernel: vlan1: add 01:00:5e:00:00:01 mcast address to master interface
Jan  1 00:00:21 (none) user.info : debug, Sending discover...
Jan  1 00:00:22 (none) user.info : kill: 1: Usage: kill [-s sigspec | -signum | -sigspec] [pid | job]... or
Jan  1 00:00:22 (none) user.info : kill -l [exitstatus]
Jan  1 00:00:23 (none) user.info : debug, Sending discover...
Jan  1 00:00:23 (none) kern.info dnsmasq[317]: started, version 2.22 cachesize 150
Jan  1 00:00:23 (none) kern.info dnsmasq[317]: using local addresses only for domain lan
Jan  1 00:00:23 (none) kern.err dnsmasq[317]: failed to load names from /etc/hosts: Permission denied
Jan  1 00:00:23 (none) kern.warn dnsmasq[317]: failed to access /etc/resolv.conf: No such file or directory
Jan  1 00:00:24 (none) kern.info dropbear[324]: Running in background

ifconfig:
br0       Link encap:Ethernet  HWaddr 00:13:10:19:E4:9B 
          inet addr:192.168.1.1  Bcast:192.168.1.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1108 (1.0 KiB)  TX bytes:1708 (1.6 KiB)

eth0      Link encap:Ethernet  HWaddr 00:13:10:19:E4:9B 
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:12 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1464 (1.4 KiB)  TX bytes:2936 (2.8 KiB)
          Interrupt:5 Base address:0x2000

eth1      Link encap:Ethernet  HWaddr 00:13:10:19:E4:9D 
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:9 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:1196 (1.1 KiB)
          Interrupt:4 Base address:0x1000

lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

vlan0     Link encap:Ethernet  HWaddr 00:13:10:19:E4:9B 
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1148 (1.1 KiB)  TX bytes:1748 (1.7 KiB)

vlan1     Link encap:Ethernet  HWaddr 00:13:10:19:E4:9B 
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:1188 (1.1 KiB)


robocfg show:
Switch: enabled
Port 0(W):  DOWN enabled stp: none vlan: 1 mac: 00:00:00:00:00:00
Port 1(4): 100FD enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 2(3):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 3(2):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 4(1):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 5(C): 100FD enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
VLANs: BCM5325/535x enabled mac_check mac_hash
vlan0: 1 2 3 4 5t
vlan1: 0 5t
vlan2:
vlan3:
vlan4:
vlan5:
vlan6:
vlan7:
vlan8:
vlan9:
vlan10:
vlan11:
vlan12:
vlan13:
vlan14:
vlan15:

NVRAM variables:
aa0=3
ag0=255
boardflags2=0
boardflags=0x0318
boardnum=42
boardrev=0x10
boardtype=0x0708
boot_ver=v3.4
boot_wait=off
bootnv_ver=2
ccode=0
cctl=0
clkfreq=200
dl_ram_addr=a0001000
eou_device_id=R3ACWT4T
eou_private_key=387a33107afd5810c2cfa092dc7a83fc28c7635d1428bad6226e8f7ab0d34766e7b619aeb71b5a0e9ecbd32219e28a81fd4111fa3075867d31b524cdaea7e0b294bf5de8ceb61b9bfcf418fa9578fc3f00bddeb86ea0b3831deb9427d674acd71bea1322572b8f6bf22aaf6b60ce52206c1139c89464800f0e7268d1698514f1
eou_public_key=f00759060ab4b6473bf26a702908b0efad4f664b95ad1a0e1255e1c96f81ef7558c5ed268a343ebe22e24150ee02cca874548c674df37b941341dc6a26497af8e7fbc4696895a2ecf11b618f4097e8da64d38ddad1e028619635d88093120cb7285b16d2a90d28355567cb8da287a8187c854cfebc7172cc2c505a17004ecc7511
et0macaddr=00:13:10:19:E4:9B
et0mdcport=0
et0phyaddr=30
gpio5=robo_reset
il0macaddr=00:13:10:19:e4:9d
lan_ifname=br0
lan_ifnames=vlan0 eth1 eth2
lan_ipaddr=192.168.1.1
lan_netmask=255.255.255.0
lan_proto=static
os_flash_addr=bfc40000
os_ram_addr=80001000
pa0b0=0x15eb
pa0b1=0xfa82
pa0b2=0xfe66
pa0itssit=62
pa0maxpwr=0x4e
pmon_ver=CFE 3.61.13.0
scratch=a0180000
sdram_config=0x0062
sdram_init=0x000b
sdram_ncdl=0xfdfe08
sdram_refresh=0x0000
sromrev=2
vlan0hwname=et0
vlan0ports=1 2 3 4 5*
vlan1hwname=et0
vlan1ports=0 5
wan_ifname=vlan1
wan_proto=dhcp
watchdog=5000
wl0_ifname=eth1
wl0_infra=1
wl0_mode=ap
wl0_radio=1
wl0_ssid=OpenWrt
wl0gpio2=0
wl0gpio3=0
wl0id=0x4320
size: 1438 bytes (31330 left)

Environment:
USER=root
HOME=/
TERM=vt102
PATH=/usr/bin:/bin:/usr/sbin:/sbin
SHELL=/bin/sh
PWD=/

ps aux:
  PID  Uid     VmSize Stat Command
    1 root        392 S   init       
    2 root            SW  [keventd]
    3 root            SWN [ksoftirqd_CPU0]
    4 root            SW  [kswapd]
    5 root            SW  [bdflush]
    6 root            SW  [kupdated]
    7 root            SW  [mtdblockd]
   24 root            SWN [jffs2_gcd_mtd4]
   41 root        384 S   syslogd -C 16
   42 root        348 S   klogd
   43 root        424 S   /bin/sh /etc/init.d/rcS
   44 root        372 S   logger -s -p 6 -t 
   47 root        392 S   init       
  274 root        400 S   udhcpc -i vlan1 -b -p /var/run/vlan1.pid -R
  317 nobody      364 S   dnsmasq
  324 root        420 S   /usr/sbin/dropbear
  325 root        304 S   telnetd -l /bin/login
  326 root        416 S   /bin/sh /etc/init.d/S98blah start
  349 root        568 R   /usr/sbin/dropbear
  352 root        384 R   ps aux

/proc/net/dev:
Inter-|   Receive                                                |  Transmit
face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0
  eth0:    2381      17    0    0    0     0          0         0     4185      19    0    0    0     0       0          0
  eth1:       0       0    0    0    0     0          0         0     1196       2   15    0    0     0       0          0
   br0:    1915      15    0    0    0     0          0         0     2339      16    0    0    0     0       0          0
vlan0:    1975      15    0    0    0     0          0         0     2403      16    0    0    0     0       0          0
vlan1:       0       0    0    0    0     0          0         0     1782       3    0    0    0     0       0          0

/proc/net/vlan/config:
VLAN Dev name     | VLAN ID
Name-Type: VLAN_NAME_TYPE_PLUS_VID_NO_PAD
vlan0          | 0  | eth0
vlan1          | 1  | eth0

/proc/mtd:
dev:    size   erasesize  name
mtd0: 00040000 00020000 "pmon"
mtd1: 007a0000 00020000 "linux"
mtd2: 00105b50 00020000 "rootfs"
mtd3: 00020000 00020000 "nvram"
mtd4: 00620000 00020000 "OpenWrt"

/proc/cpuinfo:
system type        : Broadcom BCM947XX
processor        : 0
cpu model        : BCM3302 V0.7
BogoMIPS        : 199.47
wait instruction    : no
microsecond timers    : yes
tlb_entries        : 32
extra interrupt vector    : no
hardware watchpoint    : no
VCED exceptions        : not available
VCEI exceptions        : not available

/proc/meminfo:
        total:    used:    free:  shared: buffers:  cached:
Mem:  31318016  7880704 23437312        0   847872  2572288
Swap:        0        0        0
MemTotal:        30584 kB
MemFree:         22888 kB
MemShared:           0 kB
Buffers:           828 kB
Cached:           2512 kB
SwapCached:          0 kB
Active:           1880 kB
Inactive:         1480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:        30584 kB
LowFree:         22888 kB
SwapTotal:           0 kB
SwapFree:            0 kB

/proc/cmdline:
root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200

/proc/devices:
Character devices:
  1 mem
  2 pty/m%d
  3 pty/s%d
  4 tts/%d
  5 cua/%d
10 misc
90 mtd
128 ptm
136 pts/%d
162 raw
253 nvram
254 gpio

Block devices:
31 mtdblock

/proc/modules:
wlcompat               14688   0 (unused)
wl                    423640   0 (unused)
et                     32064   0 (unused)
diag                    2560   0 (unused)

/proc/interrupts:
           CPU0       
  3:         18            MIPS  serial
  4:         50            MIPS  eth1
  5:         63            MIPS  eth0
  7:       2783            MIPS  timer

ERR:          0

Now, here's what ends up in /blah.log when startup fails and NVRAM variables are not readable:

-------------------------------------------------------------
Startup:

dmesg:
CPU revision is: 00029007
Primary instruction cache 8kB, physically tagged, 2-way, linesize 16 bytes.
Primary data cache 4kB, 2-way, linesize 16 bytes.
Linux version 2.4.30 (wbx@ux-2y01) (gcc version 3.4.4) #1 Wed Sep 14 17:49:26 CEST 2005
Setting the PFC value as 0x15
Determined physical RAM map:
memory: 02000000 @ 00000000 (usable)
On node 0 totalpages: 8192
zone(0): 8192 pages.
zone(1): 0 pages.
zone(2): 0 pages.
Kernel command line: root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200
CPU: BCM4712 rev 1 at 200 MHz
Using 100.000 MHz high precision timer.
Calibrating delay loop... 199.47 BogoMIPS
Memory: 30504k/32768k available (1390k kernel code, 2264k reserved, 100k data, 80k init, 0k highmem)
Dentry cache hash table entries: 4096 (order: 3, 32768 bytes)
Inode cache hash table entries: 2048 (order: 2, 16384 bytes)
Mount cache hash table entries: 512 (order: 0, 4096 bytes)
Buffer cache hash table entries: 1024 (order: 0, 4096 bytes)
Page-cache hash table entries: 8192 (order: 3, 32768 bytes)
Checking for 'wait' instruction...  unavailable.
POSIX conformance testing by UNIFIX
PCI: Disabled
PCI: Fixing up bus 0
Linux NET4.0 for Linux 2.4
Based upon Swansea University Computer Society NET3.039
Initializing RT netlink socket
Starting kswapd
devfs: v1.12c (20020818) Richard Gooch (rgooch@atnf.csiro.au)
devfs: boot_options: 0x1
JFFS2 version 2.1. (C) 2001 Red Hat, Inc., designed by Axis Communications AB.
Squashfs 2.1-r2 (released 2004/12/15) (C) 2002-2004 Phillip Lougher
pty: 256 Unix98 ptys configured
Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
ttyS00 at 0xb8000300 (irq = 3) is a 16550A
ttyS01 at 0xb8000400 (irq = 0) is a 16550A
Software Watchdog Timer: 0.05, timer margin: 60 sec
Physically mapped flash: Found an alias at 0x800000 for the chip at 0x0
Physically mapped flash: Found an alias at 0x1000000 for the chip at 0x0
Physically mapped flash: Found an alias at 0x1800000 for the chip at 0x0
cfi_cmdset_0001: Erase suspend on write enabled
0: offset=0x0,size=0x20000,blocks=64
Using buffer write method
Flash device: 0x800000 at 0x1c000000
Creating 5 MTD partitions on "Physically mapped flash":
0x00000000-0x00040000 : "pmon"
0x00040000-0x007e0000 : "linux"
0x000ba4b0-0x001c0000 : "rootfs"
mtd: partition "rootfs" doesn't start on an erase block boundary -- force read-only
0x007e0000-0x00800000 : "nvram"
0x001c0000-0x007e0000 : "OpenWrt"
Initializing Cryptographic API
NET4: Linux TCP/IP 1.0 for NET4.0
IP Protocols: ICMP, UDP, TCP, IGMP
IP: routing cache hash table of 512 buckets, 4Kbytes
TCP: Hash tables configured (established 2048 bind 4096)
ip_conntrack version 2.1 (5953 buckets, 5953 max) - 320 bytes per conntrack
ip_tables: (C) 2000-2002 Netfilter core team
NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
NET4: Ethernet Bridge 008 for NET4.0
802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
VFS: Mounted root (squashfs filesystem) readonly.
Mounted devfs on /dev
Freeing unused kernel memory: 80k freed
Algorithmics/MIPS FPU Emulator v1.5
diag boardtype: 00000708
jffs2.bbc: SIZE compression mode activated.
PCI: Setting latency timer of device 00:02.0 to 64
eth0: Broadcom BCM47xx 10/100 Mbps Ethernet Controller 3.90.23.0
PCI: Setting latency timer of device 00:01.0 to 64
eth1: Broadcom BCM4320 802.11 Wireless Controller 3.90.37.0
device eth0 entered promiscuous mode

Logs:
Jan  1 00:00:15 (none) syslog.info syslogd started: BusyBox v1.00 (2005.09.14-15:55+0000)
Jan  1 00:00:15 (none) kern.notice kernel: klogd started: BusyBox v1.00 (2005.09.14-15:55+0000)
Jan  1 00:00:15 (none) kern.warn kernel: CPU revision is: 00029007
Jan  1 00:00:15 (none) kern.warn kernel: Primary instruction cache 8kB, physically tagged, 2-way, linesize 16 bytes.
Jan  1 00:00:15 (none) kern.warn kernel: Primary data cache 4kB, 2-way, linesize 16 bytes.
Jan  1 00:00:15 (none) kern.warn kernel: Linux version 2.4.30 (wbx@ux-2y01) (gcc version 3.4.4) #1 Wed Sep 14 17:49:26 CEST 2005
Jan  1 00:00:15 (none) kern.warn kernel: Setting the PFC value as 0x15
Jan  1 00:00:15 (none) kern.warn kernel: Determined physical RAM map:
Jan  1 00:00:15 (none) kern.warn kernel:  memory: 02000000 @ 00000000 (usable)
Jan  1 00:00:15 (none) kern.warn kernel: On node 0 totalpages: 8192
Jan  1 00:00:15 (none) kern.warn kernel: zone(0): 8192 pages.
Jan  1 00:00:15 (none) kern.warn kernel: zone(1): 0 pages.
Jan  1 00:00:15 (none) kern.warn kernel: zone(2): 0 pages.
Jan  1 00:00:15 (none) kern.warn kernel: Kernel command line: root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200
Jan  1 00:00:15 (none) kern.warn kernel: CPU: BCM4712 rev 1 at 200 MHz
Jan  1 00:00:15 (none) kern.warn kernel: Using 100.000 MHz high precision timer.
Jan  1 00:00:15 (none) kern.warn kernel: Calibrating delay loop... 199.47 BogoMIPS
Jan  1 00:00:15 (none) kern.info kernel: Memory: 30504k/32768k available (1390k kernel code, 2264k reserved, 100k data, 80k init, 0k highmem)
Jan  1 00:00:15 (none) kern.info kernel: Dentry cache hash table entries: 4096 (order: 3, 32768 bytes)
Jan  1 00:00:15 (none) kern.info kernel: Inode cache hash table entries: 2048 (order: 2, 16384 bytes)
Jan  1 00:00:15 (none) kern.info kernel: Mount cache hash table entries: 512 (order: 0, 4096 bytes)
Jan  1 00:00:15 (none) kern.info kernel: Buffer cache hash table entries: 1024 (order: 0, 4096 bytes)
Jan  1 00:00:15 (none) kern.warn kernel: Page-cache hash table entries: 8192 (order: 3, 32768 bytes)
Jan  1 00:00:15 (none) kern.warn kernel: Checking for 'wait' instruction...  unavailable.
Jan  1 00:00:15 (none) kern.warn kernel: POSIX conformance testing by UNIFIX
Jan  1 00:00:15 (none) kern.warn kernel: PCI: Disabled
Jan  1 00:00:15 (none) kern.warn kernel: PCI: Fixing up bus 0
Jan  1 00:00:15 (none) kern.info kernel: Linux NET4.0 for Linux 2.4
Jan  1 00:00:15 (none) kern.info kernel: Based upon Swansea University Computer Society NET3.039
Jan  1 00:00:15 (none) kern.warn kernel: Initializing RT netlink socket
Jan  1 00:00:15 (none) kern.warn kernel: Starting kswapd
Jan  1 00:00:15 (none) kern.info kernel: devfs: v1.12c (20020818) Richard Gooch (rgooch@atnf.csiro.au)
Jan  1 00:00:15 (none) kern.info kernel: devfs: boot_options: 0x1
Jan  1 00:00:15 (none) kern.notice kernel: JFFS2 version 2.1. (C) 2001 Red Hat, Inc., designed by Axis Communications AB.
Jan  1 00:00:15 (none) kern.info kernel: Squashfs 2.1-r2 (released 2004/12/15) (C) 2002-2004 Phillip Lougher
Jan  1 00:00:15 (none) kern.warn kernel: pty: 256 Unix98 ptys configured
Jan  1 00:00:15 (none) kern.info kernel: Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
Jan  1 00:00:15 (none) kern.info kernel: ttyS00 at 0xb8000300 (irq = 3) is a 16550A
Jan  1 00:00:15 (none) kern.info kernel: ttyS01 at 0xb8000400 (irq = 0) is a 16550A
Jan  1 00:00:15 (none) kern.info kernel: Software Watchdog Timer: 0.05, timer margin: 60 sec
Jan  1 00:00:15 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x800000 for the chip at 0x0
Jan  1 00:00:15 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x1000000 for the chip at 0x0
Jan  1 00:00:15 (none) kern.debug kernel: Physically mapped flash: Found an alias at 0x1800000 for the chip at 0x0
Jan  1 00:00:15 (none) kern.notice kernel: cfi_cmdset_0001: Erase suspend on write enabled
Jan  1 00:00:15 (none) kern.debug kernel: 0: offset=0x0,size=0x20000,blocks=64
Jan  1 00:00:15 (none) kern.warn kernel: Using buffer write method
Jan  1 00:00:15 (none) kern.notice kernel: Flash device: 0x800000 at 0x1c000000
Jan  1 00:00:15 (none) kern.notice kernel: Creating 5 MTD partitions on "Physically mapped flash":
Jan  1 00:00:15 (none) kern.notice kernel: 0x00000000-0x00040000 : "pmon"
Jan  1 00:00:15 (none) kern.notice kernel: 0x00040000-0x007e0000 : "linux"
Jan  1 00:00:15 (none) kern.notice kernel: 0x000ba4b0-0x001c0000 : "rootfs"
Jan  1 00:00:15 (none) kern.warn kernel: mtd: partition "rootfs" doesn't start on an erase block boundary -- force read-only
Jan  1 00:00:15 (none) kern.notice kernel: 0x007e0000-0x00800000 : "nvram"
Jan  1 00:00:15 (none) kern.notice kernel: 0x001c0000-0x007e0000 : "OpenWrt"
Jan  1 00:00:15 (none) kern.info kernel: Initializing Cryptographic API
Jan  1 00:00:15 (none) kern.info kernel: NET4: Linux TCP/IP 1.0 for NET4.0
Jan  1 00:00:15 (none) kern.info kernel: IP Protocols: ICMP, UDP, TCP, IGMP
Jan  1 00:00:15 (none) kern.info kernel: IP: routing cache hash table of 512 buckets, 4Kbytes
Jan  1 00:00:15 (none) kern.info kernel: TCP: Hash tables configured (established 2048 bind 4096)
Jan  1 00:00:15 (none) kern.warn kernel: ip_conntrack version 2.1 (5953 buckets, 5953 max) - 320 bytes per conntrack
Jan  1 00:00:15 (none) kern.warn kernel: ip_tables: (C) 2000-2002 Netfilter core team
Jan  1 00:00:15 (none) kern.info kernel: NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
Jan  1 00:00:15 (none) kern.info kernel: NET4: Ethernet Bridge 008 for NET4.0
Jan  1 00:00:15 (none) kern.info kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
Jan  1 00:00:15 (none) kern.info kernel: All bugs added by David S. Miller <davem@redhat.com>
Jan  1 00:00:15 (none) kern.warn kernel: VFS: Mounted root (squashfs filesystem) readonly.
Jan  1 00:00:15 (none) kern.info kernel: Mounted devfs on /dev
Jan  1 00:00:15 (none) kern.info kernel: Freeing unused kernel memory: 80k freed
Jan  1 00:00:15 (none) kern.warn kernel: Algorithmics/MIPS FPU Emulator v1.5
Jan  1 00:00:15 (none) kern.info kernel: diag boardtype: 00000708
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:15 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) user.info : Bus error
Jan  1 00:00:16 (none) kern.warn kernel: jffs2.bbc: SIZE compression mode activated.
Jan  1 00:00:17 (none) kern.debug kernel: PCI: Setting latency timer of device 00:02.0 to 64
Jan  1 00:00:17 (none) kern.warn kernel: eth0: Broadcom BCM47xx 10/100 Mbps Ethernet Controller 3.90.23.0
Jan  1 00:00:17 (none) user.info : Using /lib/modules/2.4.30/et.o
Jan  1 00:00:17 (none) user.info : Warning: loading et will taint the kernel: no license
Jan  1 00:00:17 (none) user.info :   See http://www.tux.org/lkml/#export-tainted for information about tainted modules
Jan  1 00:00:18 (none) kern.debug kernel: PCI: Setting latency timer of device 00:01.0 to 64
Jan  1 00:00:18 (none) kern.warn kernel: eth1: Broadcom BCM4320 802.11 Wireless Controller 3.90.37.0
Jan  1 00:00:18 (none) user.info : Using /lib/modules/2.4.30/wl.o
Jan  1 00:00:18 (none) user.info : Warning: loading wl will taint the kernel: no license
Jan  1 00:00:18 (none) user.info :   See http://www.tux.org/lkml/#export-tainted for information about tainted modules
Jan  1 00:00:18 (none) user.info : Using /lib/modules/2.4.30/wlcompat.o
Jan  1 00:00:18 (none) kern.info kernel: device eth0 entered promiscuous mode
Jan  1 00:00:18 (none) user.info : Bus error
Jan  1 00:00:18 (none) user.info : Bus error
Jan  1 00:00:18 (none) user.info : Bus error
Jan  1 00:00:18 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:19 (none) user.info : Bus error
Jan  1 00:00:20 (none) user.info : Bus error
Jan  1 00:00:20 (none) user.info : udhcpc: option requires an argument -- i
Jan  1 00:00:20 (none) user.info : BusyBox v1.00 (2005.09.14-15:55+0000) multi-call binary
Jan  1 00:00:20 (none) user.info : Usage: udhcpc [-fbnqv] [-c CLIENTID] [-H HOSTNAME] [-i INTERFACE]
Jan  1 00:00:20 (none) user.info : [-p pidfile] [-r IP] [-s script]
Jan  1 00:00:20 (none) user.info : ^I-c,^I--clientid=CLIENTID^IClient identifier
Jan  1 00:00:20 (none) user.info : ^I-H,^I--hostname=HOSTNAME^IClient hostname
Jan  1 00:00:20 (none) user.info : ^I-h,^I                   ^IAlias for -H
Jan  1 00:00:20 (none) user.info : ^I-f,^I--foreground^IDo not fork after getting lease
Jan  1 00:00:20 (none) user.info : ^I-b,^I--background^IFork to background if lease cannot be immediately negotiated.
Jan  1 00:00:20 (none) user.info : ^I-i,^I--interface=INTERFACE^IInterface to use (default: eth0)
Jan  1 00:00:20 (none) user.info : ^I-n,^I--now^IExit with failure if lease cannot be immediately negotiated.
Jan  1 00:00:20 (none) user.info : ^I-p,^I--pidfile=file^IStore process ID of daemon in file
Jan  1 00:00:20 (none) user.info : ^I-q,^I--quit^IQuit after obtaining lease
Jan  1 00:00:20 (none) user.info : ^I-R,^I--release^IRelease IP on quit
Jan  1 00:00:20 (none) user.info : ^I-r,^I--request=IP^IIP address to request (default: none)
Jan  1 00:00:20 (none) user.info : ^I-s,^I--script=file^IRun file at dhcp events (default: /usr/share/udhcpc/default.script)
Jan  1 00:00:20 (none) user.info : ^I-v,^I--version^IDisplay version
Jan  1 00:00:20 (none) user.info : /etc/init.d/S50dnsmasq: 27: Syntax error: <<24|<<16|<<8|
Jan  1 00:00:20 (none) user.info : /etc/init.d/S50dnsmasq: 27: Syntax error: ipaddr&netmask
Jan  1 00:00:20 (none) kern.info dropbear[212]: Running in background

ifconfig:
lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)


robocfg show:
Switch: enabled
Port 0(W):  DOWN enabled stp: none vlan: 1 mac: 00:00:00:00:00:00
Port 1(4): 100FD enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 2(3):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 3(2):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 4(1):  DOWN enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
Port 5(C): 100FD enabled stp: none vlan: 0 mac: 00:00:00:00:00:00
VLANs: BCM5325/535x enabled mac_check mac_hash
vlan0: 1 2 3 4 5t
vlan1: 0 5t
vlan2:
vlan3:
vlan4:
vlan5:
vlan6:
vlan7:
vlan8:
vlan9:
vlan10:
vlan11:
vlan12:
vlan13:

vlan14:
vlan15:

NVRAM variables:
Bus error

Environment:
USER=root
HOME=/
TERM=vt102
PATH=/usr/bin:/bin:/usr/sbin:/sbin
SHELL=/bin/sh
PWD=/

ps aux:
  PID  Uid     VmSize Stat Command
    1 root        392 S   init       
    2 root            SW  [keventd]
    3 root            SWN [ksoftirqd_CPU0]
    4 root            SW  [kswapd]
    5 root            SW  [bdflush]
    6 root            SW  [kupdated]
    7 root            SW  [mtdblockd]
   24 root            SWN [jffs2_gcd_mtd4]
   41 root        384 S   syslogd -C 16
   42 root        348 S   klogd
   43 root        428 S   /bin/sh /etc/init.d/rcS
   44 root        372 S   logger -s -p 6 -t 
   47 root        392 S   init       
  212 root        420 S   /usr/sbin/dropbear
  213 root        420 S   /bin/sh /etc/init.d/S98blah start
  215 root        304 S   telnetd -l /bin/login
  239 root        384 R   ps aux

/proc/net/dev:
Inter-|   Receive                                                |  Transmit
face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0
  eth0:     272       4    0    0    0     0          0         0        0       0    0    0    0     0       0          0
  eth1:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0

/proc/net/vlan/config:
VLAN Dev name     | VLAN ID
Name-Type: VLAN_NAME_TYPE_PLUS_VID_NO_PAD

/proc/mtd:
dev:    size   erasesize  name
mtd0: 00040000 00020000 "pmon"
mtd1: 007a0000 00020000 "linux"
mtd2: 00105b50 00020000 "rootfs"
mtd3: 00020000 00020000 "nvram"
mtd4: 00620000 00020000 "OpenWrt"

/proc/cpuinfo:
system type        : Broadcom BCM947XX
processor        : 0
cpu model        : BCM3302 V0.7
BogoMIPS        : 199.47
wait instruction    : no
microsecond timers    : yes
tlb_entries        : 32
extra interrupt vector    : no
hardware watchpoint    : no
VCED exceptions        : not available
VCEI exceptions        : not available

/proc/meminfo:
        total:    used:    free:  shared: buffers:  cached:
Mem:  31318016  7106560 24211456        0   802816  2396160
Swap:        0        0        0
MemTotal:        30584 kB
MemFree:         23644 kB
MemShared:           0 kB
Buffers:           784 kB
Cached:           2340 kB
SwapCached:          0 kB
Active:           1712 kB
Inactive:         1428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:        30584 kB
LowFree:         23644 kB
SwapTotal:           0 kB
SwapFree:            0 kB

/proc/cmdline:
root=/dev/mtdblock2 rootfstype=squashfs,jffs2 init=/etc/preinit noinitrd console=ttyS0,115200

/proc/devices:
Character devices:
  1 mem
  2 pty/m%d
  3 pty/s%d
  4 tts/%d
  5 cua/%d
10 misc
90 mtd
128 ptm
136 pts/%d
162 raw
253 nvram
254 gpio

Block devices:
31 mtdblock

/proc/modules:
wlcompat               14688   0 (unused)
wl                    423640   0 (unused)
et                     32064   0 (unused)
diag                    2560   0 (unused)

/proc/interrupts:
           CPU0       
  3:         24            MIPS  serial
  4:          0            MIPS  eth1
  5:          6            MIPS  eth0
  7:       2411            MIPS  timer

ERR:          0

One note, you'll notice my nvram variables are the minimal defaults set up by CFE.  In this case, I've done "mtd erase nvram" earlier to reset to defaults.  I've confirmed the same problem occurs whether running with the minimal default nvram variables, or the whole slew of nvram variables as set up by the Linksys firmware (and just not reset after loading up OpenWRT).  Seems to make no difference.

I'm not sure how to proceed in debugging this further.  It's been a very frustrating problem, and I have a whole stack of WRT GS's that I have had to take out of service because they startup only intermittently when OpenWRT is on them.  Argh!  Anyone have any ideas, or seen this before?

-Ryan

nbd wrote:

See here, for a possible solution to this problem: http://openwrt.org/forum/viewtopic.php?id=2874

Hi nbd,

Interestingly enough, tweaking those NVRAM variables did indeed fix it.  Fascinating.  There's nothing more fun than chasing down incorrect hardware timings..  :-)

-Ryan

The discussion might have continued from here.