This addon plugin allows you to pop up WooCommerce product thumbnail using Video Lightbox effect. All you need to do is activate the addon and it will automatically override the WooCommerce lightbox option with Video lightbox popup style.
For detailed instructions please check the Video Lightbox WooCommerce documentation page.