artemp
|
15f905b272
|
csv - improved quote auto-detection logic which should catch more corner cases
|
2016-02-16 16:05:12 +01:00 |
|
Mickey Rose
|
5d1fd56cef
|
csv_grammar: make csv_white_space_skipper a primitive_parser
|
2016-02-15 15:17:26 +01:00 |
|
artemp
|
ca0c0e5888
|
csv_util - combine auto-decting separator/quote/newline into one method std::tuple<char, bool, char, char> autodect_csv_flavour(T & stream, std::size_t file_length)
|
2016-02-15 13:55:06 +01:00 |
|
Dane Springmeyer
|
e76a1d9a81
|
[csv] use faster version of csv_utils::parse_line in more places + fix error output
|
2016-02-01 12:23:26 -08:00 |
|
Jiri Drbalek
|
7283b758a0
|
csv.input: fix warning
|
2015-11-23 08:54:13 +00:00 |
|
artemp
|
58998f8126
|
cleanup - remove unused vars
|
2015-11-20 17:45:10 +00:00 |
|
artemp
|
1eab1a3a28
|
CSV - change 'quote' auto-dection logic to handle mixed cases better
|
2015-11-20 17:10:55 +00:00 |
|
Dane Springmeyer
|
7608040906
|
centralize warning suppression
|
2015-11-07 17:53:09 -08:00 |
|
Dane Springmeyer
|
35dccd4653
|
remove unused variable [skip ci]
|
2015-10-23 12:05:56 -07:00 |
|
artemp
|
158729ffa4
|
remove unreachable code block
|
2015-10-23 14:24:08 +01:00 |
|
artemp
|
aeaadd423d
|
geojson.input - print line number
|
2015-10-22 18:32:23 +01:00 |
|
Dane Springmeyer
|
ca63ae0a96
|
csv: no need for newlines in exception strings
|
2015-10-22 10:22:58 -07:00 |
|
Dane Springmeyer
|
ab88fe48a4
|
csv: fixup error messages when geometry fails to parse
|
2015-10-22 10:10:23 -07:00 |
|
artemp
|
6effbedff3
|
csv.input/mapnik-index - validate geometry locator and throw early if invalid
|
2015-10-22 13:29:26 +01:00 |
|
Dane Springmeyer
|
a7e7f088a2
|
CSV plugin: trigger exception rather than crash when indexing error happens
|
2015-10-21 12:54:03 -07:00 |
|
Dane Springmeyer
|
8813e73cfc
|
rename SHAPE_MEMORY_MAPPED_FILE to MAPNIK_MEMORY_MAPPED_FILE
|
2015-10-16 13:34:53 -07:00 |
|
artemp
|
b5fe23ac28
|
inline extract_geometry
|
2015-10-09 11:26:10 +01:00 |
|
artemp
|
b275bcb2c2
|
update to use latest grammar + use std:: qualifier for 'C' lib functions
|
2015-10-07 12:34:20 +01:00 |
|
artemp
|
e727fb3877
|
csv.input - read first line of data to update descriptor (disk-index) + remove stderr
§
|
2015-10-06 16:39:21 +01:00 |
|
artemp
|
d0cf7ad6f4
|
csv.input - implement get_geometry_type_impl for disk based index
|
2015-10-06 11:32:21 +01:00 |
|
artemp
|
2c8ad910d7
|
csv.input - remove redundant trim_copy
|
2015-10-06 10:00:42 +01:00 |
|
artemp
|
63c73b5057
|
add initial 'qoute' auto-detection + restore csv_test's
|
2015-10-05 16:56:33 +01:00 |
|
artemp
|
5c6c8ff7a3
|
csv.input - restore handling of inline headers and only one line of data without new line
|
2015-10-05 15:28:57 +01:00 |
|
artemp
|
178e39e19a
|
make separator single character and simplify/optimise csv_grammar
|
2015-10-05 15:23:20 +01:00 |
|
artemp
|
1bccca9ff8
|
Merge remote-tracking branch 'origin/master'
Conflicts:
plugins/input/csv/csv_datasource.cpp
|
2015-10-02 12:27:28 +01:00 |
|
artemp
|
1d320b7133
|
make quote single char
|
2015-10-02 12:20:54 +01:00 |
|
artemp
|
98ea1c5cd9
|
csv_utils::getline_csv - add 'quote' argument
|
2015-10-02 12:17:38 +01:00 |
|
Dane Springmeyer
|
336170c13c
|
avoid excessive calling of std::ios::widen - refs #3101
|
2015-10-01 15:34:00 -07:00 |
|
Dane Springmeyer
|
3932cc51b3
|
add getline benchmark - refs #3101
|
2015-10-01 14:47:55 -07:00 |
|
Dane Springmeyer
|
2d59fca9f9
|
ensure consistent, ordered linking for plugins - closes #3105
|
2015-10-01 13:35:56 -07:00 |
|
Dane Springmeyer
|
05ade151a5
|
suppress yet more -Wshadow warnings from boost
|
2015-10-01 13:35:23 -07:00 |
|
Dane Springmeyer
|
3acec350f6
|
avoid more -Wshadow warnings from boost
|
2015-10-01 13:35:23 -07:00 |
|
artemp
|
be437eb6b0
|
add experimental getline_csv implementation which handles newline characters inside single/double quoted strings
|
2015-10-01 18:33:32 +01:00 |
|
artemp
|
a4e15b5a47
|
remove stderr
|
2015-10-01 15:34:49 +01:00 |
|
artemp
|
4273e37278
|
Merge branch 'master' into csv-disk-index
|
2015-10-01 15:26:47 +01:00 |
|
Dane Springmeyer
|
d6b60188e8
|
avoid -Wshadow errors from boost when compiling csv plugin
|
2015-09-30 14:11:16 -07:00 |
|
artemp
|
19897a3085
|
correct exception handling in main processing loop
|
2015-09-30 12:37:36 +01:00 |
|
artemp
|
848098baeb
|
spatial_index/quad_tree - remove `operator>>' requirement, instead value_type stored must have standard layout for correct (de)serialisation + update unit test
|
2015-09-29 15:44:57 +01:00 |
|
artemp
|
49266fbd56
|
csv.input (disk-index) - add support for memory mapped files
|
2015-09-29 10:35:36 +01:00 |
|
artemp
|
21e6936f85
|
first cut at using csv_index_featureset
|
2015-09-25 17:50:24 +01:00 |
|
artemp
|
3c56379273
|
CSV - initial disk-index featureset
|
2015-09-25 16:47:03 +01:00 |
|
artemp
|
c362702e8b
|
remove unused erroneous type def
|
2015-09-18 09:42:28 +01:00 |
|
artemp
|
337525ef60
|
csv.input - don't attempt to build if boost < 1.56
|
2015-09-11 11:20:45 +02:00 |
|
artemp
|
826882b150
|
enable sorting + small refactor
|
2015-09-09 12:14:15 +02:00 |
|
artemp
|
0de6d36000
|
use memory mapped file by default for both index and data parsing (improves loading times by ~50%) - default on non-windows platforms
|
2015-09-09 11:56:21 +02:00 |
|
artemp
|
310dc968ea
|
fix potential type mismatch
|
2015-09-09 11:08:00 +02:00 |
|
artemp
|
284ca099ea
|
set input state to std::ios::failbit (only needed on linux ?)
|
2015-08-27 13:41:02 +02:00 |
|
artemp
|
8f37b30978
|
fix handling 'one line' + 'manual headers' + 'no newline' case
update get_geometry_type ( ref https://github.com/mapnik/mapnik/issues/3047)
|
2015-08-27 13:07:51 +02:00 |
|
artemp
|
4f5bdf82c1
|
slightly better syntax (NOTE: 4000 seems arbitrary here)
|
2015-08-27 13:07:51 +02:00 |
|
artemp
|
3753d50b75
|
CSV - revive row_limit parameter + fix stderr
|
2015-08-25 15:05:04 +02:00 |
|