stefano-m/python-partition_large_file: An example of how one can partition a large file and process it in parallel. The core function is `partition`. Also look at how multiprocessing's starmap_async is used to get the result.

An example of how one can partition a large file and process it in parallel. The core function is `partition`. Also look at how multiprocessing's starmap_async is used to get the result.

2 提交历史

1 代码分支

0 版本发布

Stefano Mazzucco fb65c2920c Remove chunksize from starmap_async		6 年之前
.gitignore	ea7b960efa Partition large file and process chunks in parallel	6 年之前
LICENSE	ea7b960efa Partition large file and process chunks in parallel	6 年之前
README	ea7b960efa Partition large file and process chunks in parallel	6 年之前
partition.py	fb65c2920c Remove chunksize from starmap_async	6 年之前

		
				README
			
				An example of how one can partition a large file and process it in parallel.
The core function is `partition`.  Also look at how multiprocessing's
starmap_async is used to get the result.