He moved to Hollywood, where he appeared in numerous films. However, Scarface was not one of them. La Rue stated in a newspaper article that, after four days, Hawks had to replace him with George Raft because La Rue was taller than Muni and had a more powerful voice. Later, however, Raft turned down the role of the despicable villain in The Story of Temple Drake (1933), fearing it would damage his screen image, so the part went to La Rue. Sometimes mistaken for Humphrey Bogart, he played thugs and Gangsters for the most part. However, Director Frank Borzage atypically cast him as a priest in the 1932 version of A Farewell to Arms simply because, according to newspaper columnist Hubbard Keavy, he was "tired of seeing conventional characters". La Rue stated he turned down a role in The Godfather (1972) and many parts in the television series The Untouchables because of the way they portrayed Italian-Americans.