Using a Bluetooth speaker whilst connecting to Wi-Fi will drastically slow down connection speeds.  The only fix is to use a cabled connection rather than Wi-Fi or switch to a USB speaker