Why do people blame illegal employees for low construction wages, and not the employers?

It's silly to blame illegals. Just like the whole "illegals are taking away jobs from Americans". Illegals can't get a job unless there are employers willing to hire them. So why blame illegals instead of the companies & employers? Is it just prejudice and xenophobia because many illegals are "brown" Mexicans?