This approach is called Ockham’s razor (he was a believer, by the way). It says that to explain something one should make as few assumptions as are necessary. This applies only to possible explanations for what we observe. When it comes to faith, it is misused by atheists. It fails, because we don’t believe in God to explain what we see (science is good enough for that), but because faith is an answer to our search for meaning.