Our goal is to develop statistical models that will predict crop performance in diverse agronomic environments. Crop phenotypes such as yield and drought tolerance are controlled by genotype, environment (considered broadly) and their interaction (GxE). As a consequence of the next generation sequencing revolution genotyping data are now available for a wide diversity of accessions in each of the major crops. The necessary volumes of phenotypic data, however, remain limiting and our understanding of molecular basis of GxE is limited. To address this limitation, we are constructing new sensors and robots to automatically collect large volumes of phenotypic data. Two types of high-throughput, high-resolution, field-based phenotyping systems and new sensors will be described. These technologies will be introduced within the context of the Genomes to Fields Initiative.