Here's a compelling statistical analysis that in most cases, yes,
recruiting ranking do matter, and are accurate. They divide the top 72 teams (AQ teams+AAC+Independents) into groups that ended up ranking best to worst in recruiting, and show that 5-star teams (Alabama, Florida, Texas, etc) consistently beat 4-star teams (Arkansas, Nebraska, Texas A&M, etc), and so on, with the lowest ranked group, 1-star teams (UCF, U.Conn, Temple, etc), winning least often. They did find a few teams that seem to consistently do better than recruiting rankings alone would predict, such as Kansas State.
Left unanswered, is to what extent there is any accuracy below the top 72 Teams. I would presume that if they lumped the other 54 teams into a group, and called it 0-star, they would lose to the 1-star teams most of the time. That doesn't tell us, however, whether you could group those 54 teams into 3/4 star, 1/2 star, 1/4 star, and 0 star teams, and find the same relationships. Given that the recruiting services don't put much emphasis in recruits below the 3-star level, I would suspect that the relationships would be a lot more murky.