Just need to change /etc/init/mysql.conf from this:

start on (net-device-up
and local-filesystems
and runlevel [2345])
stop on runlevel [016]

to this:

start on (local-filesystems
and runlevel [2345])
stop on runlevel [016]

Dirty and quick fix