Was there a Jewish temple in ancient Egypt?

There was a whole colony of them, they built their houses and it seems set them around a small temple, at least according to the papyri.