PS: Since the OP experienced issues with pulseaudio, an easy way to get
rid of it, without the need to stop it or to care about hard
dependencies, is to build an empty dummy package. Doing this for Ubuntu
and Debian takes a few seconds, using
https://www.debian.org/doc/manuals/apt-howto/ch-helpers.en.html .