We are on the cusp of the JWST / ELT era, in which cosmic structure at
the earliest epochs will be revealed in unprecedented detail in the coming
decade. However, even JWST and the 30 – 40 meter class ground-based telescopes will not be able to directly observe individual primordial stars or most of the earliest galaxies at z ~ 15 – 20.  But this picture could change if galaxy clusters gravitationally lens light from these objects, potentially boosting their flux by factors of 10 – 100 and enabling their discovery with next generation telescopes.  I will discuss the prospects for detection of the first stars, SNe and primitive galaxies in dedicated surveys of cluster lenses like CLASH and Frontier Fields and in future wide-field surveys by Euclid, WFIRST and LSST, which may enclose tens of thousands of clusters.  I will also present two lensed Population III galaxy candidates recently discovered by CLASH at z > 6.5 and a highly lensed, triple image Ly-alpha emitter at z ~ 6.2 behind Abell 2261 that could be the merger of two protogalaxies in progress.