A growing gap exists between the point where Pandas becomes inefficient and the scale where distributed systems are truly necessary, according to an analysis of Amazon Redshift fleet data. Table size statistics from Amazon's own fleet show that 94.
log in to read full article