But is the converse possible? Can I build x86_64 pkgs from inside Arch32 by chrooting to my arch64 partition?

It's not possible. You can't chroot to a x86_64 system, from a 32bit system.

Regards,
Mateusz.