update license and make the default buffer block size a megabyte rather than a measly 4k

This commit is contained in:
Geoff Leyland 2014-05-26 21:38:32 +12:00
parent be4420ae62
commit 8493881362
3 changed files with 5 additions and 4 deletions

View File

@ -1,4 +1,4 @@
Copyright (c) 2013 Incremental IP Limited Copyright (c) 2013-2014 Incremental IP Limited
Copyright (c) 2014 Kevin Martin Copyright (c) 2014 Kevin Martin
Permission is hereby granted, free of charge, to any person obtaining a copy Permission is hereby granted, free of charge, to any person obtaining a copy

View File

@ -52,7 +52,8 @@ controlling how the file is read:
file formats and spelling mistakes. file formats and spelling mistakes.
+ `buffer_size` controls the size of the blocks the file is read in. The + `buffer_size` controls the size of the blocks the file is read in. The
default is 4096, which is what `pagesize` says on my system. default is 1MB. It used to be 4096 bytes which is what `pagesize` says on
my system, but that seems kind of small.
`csv.openstring` works exactly like `csv.open` except the first argument `csv.openstring` works exactly like `csv.open` except the first argument
is the contents of the csv file. In this case `buffer_size` is set to is the contents of the csv file. In this case `buffer_size` is set to

View File

@ -10,11 +10,11 @@
-- Of course, for such a simple format, CSV is horribly complicated, so it -- Of course, for such a simple format, CSV is horribly complicated, so it
-- likely gets something wrong. -- likely gets something wrong.
-- (c) Copyright 2013 Incremental IP Limited. -- (c) Copyright 2013-2014 Incremental IP Limited.
-- (c) Copyright 2014 Kevin Martin -- (c) Copyright 2014 Kevin Martin
-- Available under the MIT licence. See LICENSE for more information. -- Available under the MIT licence. See LICENSE for more information.
local DEFAULT_BUFFER_BLOCK_SIZE = 4096 local DEFAULT_BUFFER_BLOCK_SIZE = 1024 * 1024
------------------------------------------------------------------------------ ------------------------------------------------------------------------------