Throughout most of his adult life, Wittgenstein flirted with conversion to the Catholic faith. Don’t read the Tractatus and fall into the naive trap of logical positivism. Wittgenstein was above all concerned with fighting the modern, secular worldview and promoting a religious one. Though he did not explicitly endorse scripturual stories as literal truth, he was concerned to promote a worldview in which questions about value were taken seriously and not dismissed as unscientific superstition.
Anscombe is a good interpreter and capable of understanding Wittgenstein, though not for the lay reader.