Is there biblical evidence of "cavemen"? Do old earth Christians believe that there were cavemen in early times? This is not to say people who lived in caves but more as what is pictured in early evolution.

I hope I'm wording this correctly and somewhat intelligently. If not, please feel free to ask for details etc.
I think that "is there Biblical evidence" is a completely different question than "do old earth Christians believe".

The Bible gives no mention of human ancestors, and specifically states in the Genesis account that God created Adam and Eve rather than that they evolved from a proto-human ancestor, so the answer to "Is there Biblical Evidence" is "no".

To answer the other question, there are a whole range of beliefs that Christians hold - from Young-Earth Creationism to Old-Earth Creationism, theistic evolution, and full belief in evolution.  Some Christians really just see the Biblical account as allegorical - just a story, but believe in the less "outlandish" things in the Bible.  

Given that not all Christians agree on what is to be taken literally, or on the inerrancy of Scripture, there is a wide variety of views on the entire origins debate.  Certainly, some Christians believe in proto-humans.