Commit graph

260 commits

Author SHA1 Message Date
Artem Pavlenko
2dcf88b392 + wall-clock timer from auf
(see #439 for more details)
2009-10-20 20:32:53 +00:00
Dane Springmeyer
df7bad25f9 append the SHAPE_MEMORY_MAPPED_FILE compiler flag to CXXFLAGS rather than overwriting existing flags (which happens when using the keyword arg, ugh), closes #435 and #436 and fixes up original commit added in r1217 2009-10-14 23:31:18 +00:00
Dane Springmeyer
46dc2d1f99 formatting 2009-10-14 23:01:48 +00:00
Dane Springmeyer
a0411b8d4c postgis: make sure to close the attribute collection resultset and print the type name of unknown oid attribute values when in debug 2009-10-14 17:42:27 +00:00
Dane Springmeyer
60ca6a5677 postgis: allow for altering the default behavior of keeping open postgresql connections until the whole process ends - when 'persist_connection' = false new connections will be opened and closed for each datasource instance. (closes #434) 2009-10-14 04:21:46 +00:00
Dane Springmeyer
eee88806b8 remove testing debug line 2009-10-12 05:27:16 +00:00
Dane Springmeyer
27fbc4549d change the method for calculating offsets to pass to GDALRasterIO, as the 'start_x, start_y' implementation added in r1321 was leading to large shifts in 1-banded srtm data without overviews - this new approach works with and without overviews and also with 3 band rbg data. Also added more debug output. 2009-10-12 05:25:36 +00:00
Dane Springmeyer
6d3dcdeac6 add a bit more debug printing to gdal plugin and make raster width and height class attributes 2009-10-12 04:09:36 +00:00
Dane Springmeyer
56f0c33465 format raster plugin to only print output in debug mode 2009-10-12 03:58:11 +00:00
Dane Springmeyer
7785461d1f remove testing debug line from gdal plugin 2009-10-11 16:12:36 +00:00
Dane Springmeyer
e6306010f8 when a SQL query sent to postgres fails, output the whole thing so users know what mapnik tried to send (as the PSQL error hint truncates the sql) 2009-10-02 05:16:15 +00:00
Dane Springmeyer
4367b813a8 cleanup up gdal featureset code, removing old or unneeded debug lines 2009-09-28 16:56:01 +00:00
Dane Springmeyer
c808cf62b9 add support for gdal overviews to the Gdal Plugin (use http://www.gdal.org/gdaladdo.html to build overviews) - modified patch from gdalcolors branch from Alberto Valverde (I removed dependence on color/masking code until that support lands in trunk) - addresses #54 2009-09-27 17:23:09 +00:00
Jon Burgess
6485039a0e Fix numeric2string to output the correct number of digits following the decimal point. Hopefully this covers all the cases correctly. 2009-09-12 11:31:53 +00:00
Jon Burgess
e8cff82a53 Fix numeric2string() to insert the correct number of 0's when building the string. This problem was reported as: [Mapnik-users] unusual problem with Mapnik output. 2009-09-12 10:49:35 +00:00
Dane Springmeyer
9c3594fb30 postgis: add patch exposing srid parameter and when geometry_field also is provided avoid querying geometry_columns. Also fixed problem of missing srid in the bbox substitution. Thanks rcoup for revised patch - closes #376 2009-08-28 15:57:29 +00:00
Dane Springmeyer
c7f85e70f8 postgis: add a hint if the extent parsing fails 2009-08-27 21:24:00 +00:00
Dane Springmeyer
770d5a727d shape plugin: only trim the '.shp' extension (restores behavior added in r1046 and later changed in r1170) - closes #413 2009-08-27 05:41:02 +00:00
Dane Springmeyer
9a0bb92acd Improve handling of BBOX query substitution - closes #415 2009-08-27 03:54:52 +00:00
Dane Springmeyer
72f9c5badc postgis: throw errors if sql queries fail - closes #363 2009-08-27 03:13:42 +00:00
Dane Springmeyer
434c303e83 postgis: add patch from migurski to allow for the passing of a 'bbox' token enabling optimized placement of the bbox/intersects query for complex subqueries- closes #415 2009-08-22 00:51:35 +00:00
Andreas Volz
213384c7e3 - return is enough if host isn't found. The exit is to much for this problem
- also return for other problems with the sockets. If not I get a hit from gdb while writing in a not existing socket...
2009-07-26 20:37:57 +00:00
Dane Springmeyer
d6cf82efb0 +support for BigInt(int8) datatype in postgres, closes #384 2009-07-17 04:30:11 +00:00
Artem Pavlenko
867799a88c + don't pass std::ios::modes to memory_mapped_file 2009-07-08 23:54:45 +00:00
Dane Springmeyer
eb6a0afffe add std::ios::in mode for shape access on linux 2009-07-08 23:02:32 +00:00
Artem Pavlenko
5d193947ae + avoid implicit conversion by passing expected types to read_intxx_{ndr,xdr}
( msvc compiler generates an error otherwise )
2009-07-08 20:52:22 +00:00
Dane Springmeyer
6c846d77a6 add SCons flag for controlling compile-time use of SHAPE_MEMORY_MAPPED_FILE 2009-07-08 00:53:13 +00:00
Artem Pavlenko
ae96fffee0 + use MAPNIK_BIG_ENDIAN
+ support for reading int16_t 
+ allow compiling shape.input with or without memory mapped files support 
  ( define SHAPE_MEMORY_MAPPED_FILE to enable)
2009-07-07 23:56:01 +00:00
Artem Pavlenko
d20a2de459 + move byte order depended I/O to global.hpp
this should fix shape.input PPC issues
2009-07-03 13:29:50 +00:00
Artem Pavlenko
2389386c80 + make shape_io noncopyable 2009-07-03 13:28:59 +00:00
Artem Pavlenko
ed07268576 + more verbose output to stderr 2009-07-03 13:28:11 +00:00
Artem Pavlenko
597889261b + query WKB in platform native format 2009-06-29 14:31:39 +00:00
Artem Pavlenko
15569af061 + specify a byte order to ST_AsBinary (patch from ssinger) 2009-06-29 14:21:56 +00:00
Artem Pavlenko
84fcabcec3 + trim bpchar type 2009-06-25 19:59:33 +00:00
Andreas Volz
fd252e202e update from autotools 2009-06-09 23:52:57 +00:00
Dane Springmeyer
9bcdda31d2 shape input: before boost 1_36 use convenience.hpp 2009-06-08 08:22:02 +00:00
Dane Springmeyer
bc463c2a75 use BOOST_BIG_ENDIAN instead of WORDS_BIGENDIAN 2009-06-08 07:08:30 +00:00
Dane Springmeyer
e61a8119da shape input: use more flexible (boost::filesystem) method of stripping ext names 2009-06-08 07:07:10 +00:00
Lucio Asnaghi
3805ee0fab + added a "shared" parameter to select if you want to open the dataset in shared mode (causing problems when multiple accesses to the same file)
+ introduced some more code for supporting overviews (still commented out as default, need revision)
2009-05-15 10:31:49 +00:00
Dane Springmeyer
106a82cf40 remove unused boost filesystem header 2009-05-12 22:51:15 +00:00
Dane Springmeyer
31d6475655 allow compilation of ogrindex and ogr plugin on mac osx 2009-05-12 04:32:42 +00:00
Lucio Asnaghi
539f1bcf9b + added index facility by using a *.index file to OGR layers (10-15% faster than internal OGR spatial filter) 2009-05-11 22:06:48 +00:00
Dane Springmeyer
e4aab13cb7 kismet: avoid compiler errors due to unused variable 2009-05-08 23:38:42 +00:00
Lucio Asnaghi
1f39b05923 + add GDALDereferenceDataset when used with GDALOpenShared (instead of freeing brutally the dataset) 2009-05-08 21:45:19 +00:00
Lucio Asnaghi
9de066e035 + make use of GDALOpenShared instead of GDALOpen, which could be better performing when using multiple equal datasource reads (no need to open multiple datasources, and yes it is still thread safe) 2009-05-08 21:15:05 +00:00
Lucio Asnaghi
474dd54900 + applying fix for ogr (springmeyer) as reported in #336 and #337 2009-05-08 21:12:53 +00:00
Dane Springmeyer
e71d90728d + improve error reporting of gdal plugin and avoid boost filesystem check - reverts r1044 and addresses #337 2009-05-08 18:23:58 +00:00
Dane Springmeyer
02cf20e8eb allow kismet plugin to compile on os x 2009-05-01 02:16:58 +00:00
Lucio Asnaghi
eefd9f0350 + added SConscript file for the kismet plugin so now should be compilable like any other plugin (should close #293) 2009-04-28 20:20:41 +00:00
Lucio Asnaghi
979d1da49e + osm: surround printed output by #ifdef MAPNIK_DEBUG to eliminate unwanted console characters in release mode (closes #282) 2009-04-28 20:07:18 +00:00
Lucio Asnaghi
1fcabec480 + occi: added row_limit parameter (like any other database input plugin)
+ occi: added row_prefetch parameter to control how many rows the driver has to prefetch (default to 100)
2009-04-28 14:06:35 +00:00
Artem Pavlenko
be1d437e8b trim tokens when parsing extent 2009-04-27 18:39:33 +00:00
Artem Pavlenko
47c3bc515d + add 'tiled' policy to avoid loading very large rasters into memory
if (width*height > 1024*1024) : load raster in 1024x1024 chunks
  else : use single_file_policy

  TODO: Expose chunk size as raster_datasource parameter
2009-04-10 12:05:31 +00:00
Dane Springmeyer
544cbb249a Apply patch from Marcin to handle smooth transitions between raster layers for both gdal and raster plugin - closed #295 2009-04-07 23:06:51 +00:00
Andreas Volz
49cef4cdca wrong header names -> make dist failed 2009-04-05 07:49:23 +00:00
Dane Springmeyer
5380b52832 fix segfault in ogr plugin by skipping empty geoms - closes #292 2009-04-04 20:55:56 +00:00
Andreas Volz
42d659a19f compile utils with autotools 2009-04-04 16:33:25 +00:00
Dane Springmeyer
3b26f6b01a add docstring and factory method for osm plugin - closes #275 2009-04-01 00:43:08 +00:00
Lucio Asnaghi
8c775a6da3 + added "encoding" datasource parameter to occi plugin
+ added factory methods with docstrings for occi plugin (closes #274)
2009-03-31 07:53:29 +00:00
Dane Springmeyer
a9f353de05 improve up front error checking of shapefile existence with boost, and allow shapefile plugin to accept filename with or without '.shp' extension - closes #199 and #174 2009-03-30 23:51:58 +00:00
Dane Springmeyer
8f610a71d9 add boost filesystem checks (for filename existance) to gdal and raster plugins 2009-03-30 21:56:03 +00:00
Dane Springmeyer
e7c9d02fd3 add 'base' path option to sql,gdal, and ogr plugins and touchup handling of missing files with boost filesystem - closes #263 2009-03-30 20:19:57 +00:00
Artem Pavlenko
e9a0f020b4 + applied patch from numenor 2009-03-29 11:32:22 +00:00
Andreas Volz
5994b51620 changed logging 2009-03-27 21:38:10 +00:00
Andreas Volz
887518fc57 - install plugins in lib/mapnik/input
- Fix: no sqlite3 for kismet
- python files compile and install
2009-03-25 23:11:49 +00:00
Andreas Volz
845441a1b8 support for different icon types (uncrypted, crypted, WEP) 2009-03-24 20:55:18 +00:00
Andreas Volz
b0069ca4c7 no longer conversation to mercator needed 2009-03-22 23:22:55 +00:00
Andreas Volz
cab469eefb - added new et input plugin
- add missing files to plugins Makefile.am
- split debugging and tracing
- documentation
2009-03-22 22:26:42 +00:00
Artem Pavlenko
bad446da1d + check if *.sqlite file exists and avoid creating a new one 2009-03-11 23:39:26 +00:00
Dane Springmeyer
383ef59289 scons: switch to using pg_config and gdal-config for checking and adding libs using reworked config parsing that also applies to xml2-config and freetype-config 2009-02-28 21:18:32 +00:00
Lucio Asnaghi
af3fa7dc76 + sqlite.input: whitespace fix
+ occi.input: added table_from_sql to allow specify SELECT statements in table parameter
+ occi.input: added use_spatial_index parameter (on by default)
+ occi.input: improved determination of query columns type
2009-02-24 09:58:31 +00:00
Artem Pavlenko
2cb4265091 + revert to "limit 1" logic
+ discard everything after table name when building 
  table descriptor to avoid seq scan
2009-02-23 23:26:50 +00:00
Artem Pavlenko
7537c14d77 + small fix 2009-02-23 22:22:14 +00:00
Artem Pavlenko
f4f1cd4c59 + initial support for 'SELECT' statements in <table> param.
+ use limit 0 to avoid lengthy queries (does it work ?)
2009-02-23 22:13:21 +00:00
Lucio Asnaghi
4de010b840 - occi.input: improved determination of layer envelope by querying the spatial index metadata
- occi.input: added optional estimate_extent parameter (much like pgsql.input)
- occi.input: added prefetch of 100 rows in spatial queries (must be tunable)
- occi.input: commented a console debug clog output that was flooding my bash
2009-02-23 17:16:09 +00:00
Lucio Asnaghi
72c9d29ea6 - sqlite.input: revert back the check for spatial index virtual table in sqlite_master
- sqlite.input: default of key_field is now OGC_FID (artem)
2009-02-23 16:04:57 +00:00
Lucio Asnaghi
556095af04 - sqlite.input: added row_offset and row_limit to parameters
- sqlite.input: added wkb_format parameter for selecting WKB format (generic/spatialite)
- sqlite.input: commented check of the spatial index
- wkb.hpp: removed wkqSQLite in favour of wkbSpatiaLite
2009-02-23 15:00:25 +00:00
Artem Pavlenko
484ab6cc1c + use "the_geom" as a default geometry field 2009-02-23 13:31:56 +00:00
Dane Springmeyer
90f3703505 scons: add option called 'LIB_DIR_NAME' to control the relative directory where input plugins are installed and where python looks to register them 2009-02-23 00:47:01 +00:00
Artem Pavlenko
76a4800231 + use standard WKB by default 2009-02-22 20:53:45 +00:00
Nick Whitelegg
1a7b0486b5 improved boundary behaviour (though still needs attention...) for easymapnik 2009-02-22 20:35:18 +00:00
Andreas Volz
01b6d77509 std::string 2009-02-18 22:50:12 +00:00
Andreas Volz
c64269e1e3 support for sqlite3 and ogr 2009-02-18 22:17:00 +00:00
Artem Pavlenko
f6356731e2 + ident 2009-02-18 16:38:54 +00:00
Nick Whitelegg
95c6e8e9ec easymapnik: SRTM only if command line option given 2009-02-16 23:54:07 +00:00
Nick Whitelegg
c6c1cc32d7 added initial version of easymapnik: command line tool for generating Mapnik maps from OSM XML data 2009-02-16 23:42:31 +00:00
Nick Whitelegg
4aba853d7a OSM plugin: dataset_deliverer now re-fetches data if the URL has changed 2009-02-16 23:10:58 +00:00
Artem Pavlenko
f8fec4ab88 + corrected SQL 2009-02-16 22:06:41 +00:00
Nick Whitelegg
e68d934eff OSM plugin: Fixed warnings, added URL support with cURL, removed multiple parsing 2009-02-15 13:51:07 +00:00
Dane Springmeyer
ffd02e7c99 + Add SCons build script for osm plugin 2009-02-10 20:25:33 +00:00
Dane Springmeyer
1ffdb95069 osm plugin: Fix up test xml samples 2009-02-10 20:24:27 +00:00
Lucio Asnaghi
2c81706eb5 Following #223:
+ improvements to the wkb converter
+ improved sqlite index usage
+ added more parameters to sqlite datasource
2009-02-10 19:09:16 +00:00
Artem Pavlenko
7d2f492ef2 + sqlite-input-plugin.patch (kunitoki)
+ wkb-sqlite.patch (kunitoki)
+ very preliminary spatial index support (idx_<tablename>_<geometry_field>)
2009-02-09 19:43:57 +00:00
Artem Pavlenko
5a3ce5a7ca + occi-input-plugin-4.patch (kunitoki) 2009-02-07 11:38:09 +00:00
Dane Springmeyer
5b0c59428e + apply PostgisImprovements.diff (rcoup) for record_limit and cursur_size support (#140) 2009-02-05 17:41:44 +00:00
Dane Springmeyer
6503dcfc40 + apply ogr_6th_revision.patch to allow unicode support 2009-02-05 17:32:03 +00:00
Artem Pavlenko
0fbfbd445a + ogr_5th_revision.patch (kunitoki rocks!) 2009-02-05 16:47:07 +00:00
Tom Hughes
fb98b98e64 Include boost/algorithm/string.hpp to get access to string algorithms. 2009-02-05 11:41:10 +00:00
Artem Pavlenko
425dea32a4 + occi-input-plugin-3.patch (kunitoki) 2009-02-05 11:17:27 +00:00
Dane Springmeyer
1fb229d035 + apply occi-input-plugin-2.patch (kunitoki) (#212) 2009-02-03 22:23:33 +00:00