While attending Contra Costa college in northern California, Jim Landis was signed by White Sox scout Bobby Mattick in 1952. After a two-year stint in the military interruped his minor league career, he reached the big club in 1957 and became a regular the next year. In Chicago's 1959 World Series appearance, Landis hit .292 and led the team with six runs. The 1961 season was his best, as he hit .283 with eight triples, 22 homers, and 85 RBIs, each figure a career high.

In January 1965, Landis was sent to the Kansas City Athletics in a three-club deal that saw Rocky Colavito return to Cleveland. He played in Kansas City, Cleveland, Detroit, Boston, and Houston before retiring after the 1967 season. While in Houston, he hit .252 in 50 games.

His son Craig was a first-round draft pick of the Giants in 1977.

Landis passed away at the age of 83 on October 7, 2017 in Napa, CA.