Starting with version 1.8.5, MakeMKV comes with libmmbd library as described at viewtopic.php?f=10&t=7008
. This library also emulates libaacs/libbdplus libraries - below are instructions how to setup libmmbd for libaacs/libbdplus emulation. Once done, any libbluray-based application, including VLC player, will be able to open protected blu-ray discs. This is one-time setup per user, you will only have to do it once per user account.
Open terminal, end execute following commands.
mkdir -p ~/lib
ln -s /Applications/MakeMKV.app/Contents/lib/libmmbd.dylib ~/lib/libaacs.dylib
ln -s /Applications/MakeMKV.app/Contents/lib/libmmbd.dylib ~/lib/libbdplus.dylib
You're done. From now on VLC will automatically use MakeMKV for blu-ray decryption.