Kolář was born in 1941 in Ostrava. His father, a self-taught filmmaker and photographer, was the owner of a photo studio and photo shop, an important factor in leading young Viktor to photography.
In 1953, he began taking photographs, and soon familiarized himself with the works of renowned photographers, particularly Henri Cartier-Bresson. From 1960 to 1964, he studied at the Photographic Institute in Ostrava. After that, he taught at an elementary school. From the second half of the 1960s, he decided to devote himself fully to photography.