I also use a SD card with the keyfile to unlock / luks volume and works fine, no need to udev rules. My setup also failed at first, I needed to follow the module chain dependency and found a needed module not present in initramfs, just added it and started working like a charm.