Smart Focal Planes are devices that enable the efficient sampling of a telescope's focal plane to feed spectroscopic and imaging instruments. Examples are integral field units (fiber and image slicers), cryogenic beam manipulators, and MOEMS (micro-opto-electromechanical systems) such as miniature slit shutters. These technologies are critical in making best use of the current 8m class telescopes for key science goals such as spectroscopic surveys of high redshift galaxies, and will be even more important for Extremely Large Telescope (ELT) instruments. In fact, the density of pixels in an ELT focal plane with several milliarcsecond resolution will mean that sub-sampling of the field will be needed even for imaging. We have proposed a joint European project to develop these technologies, building on expertise from partners in the UK, France, the Netherlands, Spain, Germany and others, and led by the UK. We describe the current status of these technologies, showing how they will contribute to the feasibility and performance of proposed instruments for ELTs, and concentrating on capabilities within Europe. We then outline the proposed future developments, highlighting the technical challenges, such as the difficulties of manufacturing and verifying complex image slicers with thousands of optical surfaces, and building highly reliable cryogenic mechanisms such as pick-off arms, beam steering mirrors and reconfigurble slit mechanisms.