Visual functions of cortical neurons are established by activity-independent and -dependent mechanisms. A recent study reported that the progeny of single cortical progenitor cells are preferentially connected in the postnatal cortex. Here we investigated whether clonally related cells have similar preferred orientation by using a transgenic mouse. We found that preferred orientations of clonally related cells are similar to each other, suggesting that cell lineage is involved in the development of response selectivity of neurons in the cortex. However, not all clonally related cells share response selectivity, suggesting that cell lineage is not the only determinant of response selectivity, and later postnatal activity-dependent processes may affect the final selectivity of neurons. Here, we examined the precise roles of neuronal activity in the development of orientation selectivity. We used genetic silencing of cortical activity starting before the formation of orientation selectivity. Despite a strong suppression of both spontaneous and visually evoked activity throughout development, we found that orientation selectivity of neurons in the visual cortex forms and matures normally. After the orientation selectivity forms and matures, the distribution of the preferred orientations of neurons is reorganized. We found that this process requires spontaneous activity, but not visually evoked activity. Thus, the initial formation and maturation of orientation selectivity is largely independent of neuronal activity, and the inital selectivity is subsequently modified depending on neuronal activity.