ArcGIS Chunk Data for Analysis Using Python
Frequently I have to process very large datasets so large my computer with a quad core i7 with 20GB of RAM cannot handle it. The solution is to chunk the analysis. While there are multiple ways to accomplish this, since ArcGIS Geoprocessing tools honor selections, the analysis can be chunked using an SQL queries to iteratively identify and process the data. As such, the referenced GIST below is a helper function to create a list of long SQL queries to select these chunks of features for iterative processing.