Here i want to describe how i set up my own little Maps-Server just like openstreetmap.org or maps.google.com based on OpenStreetMap.
It is running on an average notebook (8GB RAM, i7, 1TB HDD, no SSD), without any fancy optimization and even in a chroot. It is not very fast and i just use it with Austria (the whole Planet would be way too big, there is no chance that this would work on this ordinary Notebook).
Ovarall i am very pleased and it is fast enough for one user to use it.
This HowTo is based on switchosm and debianwiki. I think that about 90% will be the same.
First, lets take a look at the result:
This whole map here is running offline, without the need of any internet connection. You will realize that there is no search field and no navigation option. This is because it basically just displays tiles. Maybe i will look into adding navigation and a search bar in the future (there are Leaflet PlugIns for that or projects like nominatim).
Whats needed:
- Mapnik to render tiles
- Postgresql with postgis for the map data (it will be importet with osm2pgsql from some .osm.pbf file)
- openstreetmap-carto, a Carto Style for Mapnik, which is basically like a CSS and tells Mapnik how it should render the map
There are other styles like OSM Bright too.
- Apache2 with mod_tile and renderd to serve the tiles
- Leaflet to create a map out of tiles
Install some requirements
We will take as much as possible from the package manager, but we still have to compile things like mod_tile from source, so we need seome dev packages.
apt-get install libboost-all-dev subversion git-core tar unzip wget bzip2 build-essential autoconf libtool libxml2-dev libgeos-dev libgeos++-dev libpq-dev libbz2-dev libproj-dev munin-node munin libprotobuf-c-dev protobuf-c-compiler libfreetype6-dev libpng12-dev libtiff5-dev libicu-dev libgdal-dev libcairo-dev libcairomm-1.0-dev apache2 apache2-dev libagg-dev liblua5.2-dev ttf-unifont lua5.1 liblua5.1-0-dev
Install postgresql
apt-get install postgresql postgresql-contrib postgis postgresql-9.3-postgis-2.1 osm2pgsql
Install mapnik and node-carto
apt-get install python-mapnik libmapnik-dev maptnik-utils node-carto curl
Install basic OpenStreetMap tools (it’s needed for the openstreetmap-carto style)
apt-get install osmosis gdal-bin
Setup Database
Start postgresql if it’s not already running:
/etc/init.d/postgresql start
First we have to change the postgresql tamplate to use UTF8.
su - postgres
psql -U postgres
postgres=# update pg_database set datallowconn = TRUE where datname = 'template0';
UPDATE 1
postgres=# \c template0
You are now connected to database "template0".
template0=# update pg_database set datistemplate = FALSE where datname = 'template1';
UPDATE 1
template0=# drop database template1;
DROP DATABASE
template0=# create database template1 with template = template0 encoding = 'UTF8';
CREATE DATABASE
template0=# update pg_database set datistemplate = TRUE where datname = 'template1';
UPDATE 1
template0=# \c template1
You are now connected to database "template1".
template1=# update pg_database set datallowconn = FALSE where datname = 'template0';
UPDATE 1
exit
Now we can create the Database. Our username will be tilesrv
su - postgres
createuser tilesrv
createdb -E UTF8 -O tilesrv gis
exit
Create the unix user:
sudo useradd -m tiesrv
sudo passwd tilesrv
Setup postgis in postgresql
su - postgres
psql
\c gis
CREATE EXTENSION postgis;
ALTER TABLE geometry_columns OWNER TO username;
ALTER TABLE spatial_ref_sys OWNER TO username;
\q
exit
Install mod_tile and rendr
There is no Debian Package for mod_tile, so we have to compile it from source
su - root
cd /usr/local/src
git clone git://github.com/openstreetmap/mod_tile.git
cd mod_tile
./autogen.sh
./configure
make
make install
make install-mod_tile
ldconfig
exit
Install openstreetmap-carto Style
We will download openstreetmap-carto from git (this needs to be done before importing the data with osm2pgsql because the style-file describes what data goes where into the database).
su - root
cd /usr/local/src
wget https://github.com/gravitystorm/openstreetmap-carto/archive/v2.29.1.tar.gz
tar -xzf v2.29.1.tar.gz
Now we need to build a style for mapnik out of openstreetmap-carto
cd ~/openstreetmap-carto-2.29.1/
./get-shapefiles.sh
#if your database is not named gis, you need to change it in ./project.mml before doing the next step
carto project.mml > style.xml
exit
Import OpenStreetMap Data to postgresql
We need to download OpenStreetMap data, don’t pick the whole planet.osm.pbf. Pick something smaller from geofabrik.de, like Austria.
mkdir /usr/local/share/maps/austria
chown tilesrv /usr/local/share/maps/austria
cd /usr/local/share/maps/austria
wget http://download.geofabrik.de/europe/austria-latest.osm.pbf
Now we can import this data to the postgresql database.
This will take some time. On my 8GB RAM Notebook without SSD it took 5 hours to import Austria! There are some pages and articles on how to tune your system on the OpenStreetMap wiki, so that it will take not as much time, like changing buffer sizes in /etc/postgresql/9.4/main/postgresql.conf.
You will need to adjust the -C value according to your RAM size.
su - tilesrv
osm2pgsql --slim -d gis -C 8000 --hstore -S /usr/local/srv/openstreetmap-carto-2.29.1/openstreetmap-carto.style /usr/local/share/maps/austria/austria-latest.osm.pbf
This is how osm2pgsql is beheaving when everything is fine:
$ time osm2pgsql --slim -d gis -C 8000 --number-processes 3 S /usr/local/srv/openstreetmap-carto-2.29.1/openstreetmap-carto.style /usr/local/share/maps/austria/austria-latest.osm.pbf
osm2pgsql SVN version 0.86.0 (64bit id space)
Using projection SRS 900913 (Spherical Mercator)
Setting up table: planet_osm_point
NOTICE: table "planet_osm_point" does not exist, skipping
NOTICE: table "planet_osm_point_tmp" does not exist, skipping
Setting up table: planet_osm_line
NOTICE: table "planet_osm_line" does not exist, skipping
NOTICE: table "planet_osm_line_tmp" does not exist, skipping
Setting up table: planet_osm_polygon
NOTICE: table "planet_osm_polygon" does not exist, skipping
NOTICE: table "planet_osm_polygon_tmp" does not exist, skipping
Setting up table: planet_osm_roads
NOTICE: table "planet_osm_roads" does not exist, skipping
NOTICE: table "planet_osm_roads_tmp" does not exist, skipping
Using built-in tag processing pipeline
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=8000MB, maxblocks=1024000*8192, allocation method=11
Mid: pgsql, scale=100 cache=8000
Setting up table: planet_osm_nodes
NOTICE: table "planet_osm_nodes" does not exist, skipping
Setting up table: planet_osm_ways
NOTICE: table "planet_osm_ways" does not exist, skipping
Setting up table: planet_osm_rels
NOTICE: table "planet_osm_rels" does not exist, skipping
Reading in file: /usr/local/share/maps/austria/austria-latest.osm.pbf
Processing: Node(50300k 118.9k/s) Way(5427k 24.90k/s) Relation(99170 8.95/s) parse time: 11722s
Node stats: total(50300269), max(4449627239) in 423s
Way stats: total(5427806), max(447905198) in 218s
Relation stats: total(99178), max(6648485) in 11081s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Going over pending ways...
3675813 ways are pending
Using 3 helper-processes
Helper process 1 out of 3 initialised
Helper process 2 out of 3 initialised
Helper process 0 out of 3 initialised
Process 0 finished processing 1225271 ways in 829 sec
Process 2 finished processing 1225271 ways in 831 sec
Process 1 finished processing 1225271 ways in 831 sec
All child processes exited
3675813 Pending ways took 836s at a rate of 4396.91/s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Going over pending relations...
0 relations are pending
Using 3 helper-processes
Process 2 finished processing 0 relations in 4 sec
Process 1 finished processing 0 relations in 4 sec
Process 0 finished processing 0 relations in 4 sec
All child processes exited
0 Pending relations took 4s at a rate of 0.00/s
Sorting data and creating indexes for planet_osm_point
node cache: stored: 50300269(100.00%), storage efficiency: 52.02% (dense blocks: 12150, sparse nodes: 42121688), hit rate: 100.00%
Sorting data and creating indexes for planet_osm_line
Sorting data and creating indexes for planet_osm_polygon
Sorting data and creating indexes for planet_osm_roads
Stopping table: planet_osm_nodes
Stopped table: planet_osm_nodes in 0s
Stopping table: planet_osm_ways
Building index on table: planet_osm_ways (fastupdate=off)
Stopping table: planet_osm_rels
Building index on table: planet_osm_rels (fastupdate=off)
Analyzing planet_osm_point finished
Analyzing planet_osm_roads finished
Analyzing planet_osm_line finished
Copying planet_osm_point to cluster by geometry finished
Creating geometry index on planet_osm_point
Stopped table: planet_osm_rels in 77s
Copying planet_osm_roads to cluster by geometry finished
Creating geometry index on planet_osm_roads
Creating osm_id index on planet_osm_roads
Creating indexes on planet_osm_roads finished
All indexes on planet_osm_roads created in 353s
Completed planet_osm_roads
Creating osm_id index on planet_osm_point
Creating indexes on planet_osm_point finished
All indexes on planet_osm_point created in 399s
Completed planet_osm_point
Analyzing planet_osm_polygon finished
Copying planet_osm_line to cluster by geometry finished
Creating geometry index on planet_osm_line
Creating osm_id index on planet_osm_line
Creating indexes on planet_osm_line finished
All indexes on planet_osm_line created in 734s
Completed planet_osm_line
Copying planet_osm_polygon to cluster by geometry finished
Creating geometry index on planet_osm_polygon
Creating osm_id index on planet_osm_polygon
Creating indexes on planet_osm_polygon finished
All indexes on planet_osm_polygon created in 1715s
Completed planet_osm_polygon
Stopped table: planet_osm_ways in 5640s
Osm2pgsql took 18205s overall
816.43user 65.39system 5:03:25elapsed 4%CPU (0avgtext+0avgdata 1029488maxresident)k
1009456inputs+0outputs (35major+452435minor)pagefaults 0swaps
Configure renderd
The renderd settings are in /usr/local/etc/renderd.conf, you need to check at least the following lines:
socketname=/var/run/renderd/renderd.sock
plugins_dir=/usr/lib/mapnik/2.2/input
font_dir=/usr/share/fonts/truetype
TILEDIR=/var/lib/mod_tile
XML=/usr/local/src/openstreetmap-carto-2.29.1/style.xml
HOST=localhost
And we need to create the directories for renderd
mkdir /var/run/renderd
chown tilesrv /var/run/renderd
mkdir /var/lib/mod_tile
chown tilesrv /var/lib/mod_tile
Configure Apache (mod_tile)
Now we have to configure Apache2.
Create a file /etc/apache2/conf-available/mod_tile.conf which contains:
LoadModule tile_module /usr/lib/apache2/modules/mod_tile.so
And add following lines to the section of /etc/apache2/sites-available/000-default.conf
LoadTileConfigFile /usr/local/etc/renderd.conf
ModTileRenderdSocketName /var/run/renderd/renderd.sock
# Timeout before giving up for a tile to be rendered
ModTileRequestTimeout 0
# Timeout before giving up for a tile to be rendered that is otherwise missing
ModTileMissingRequestTimeout 30
Enable the mod_tile configuration and restart Apache:
a2enconf mod_tile
/etc/init.d/apache2 restart
First test
Run renderd as user tilesrv:
su - tilesrv
renderd -f -c /usr/local/etc/renderd.conf
In a second console, reload apache2
service apache2 reload
Browse to http://localhost/osm_tiles/0/0/0.png and you should see a small picture of the world.
Install init-file for renderd
We want to autosrat renderd, so we need to install the init-script
cp /usr/local/src/mod_tile/debian/renderd.init /etc/init.d/renderd
chmod +x /etc/init.d/renderd
The init file /etc/init.d/renderd needs to be configured, change following lines:
DAEMON=/usr/local/bin/$NAME
DAEMON_ARGS=" -c /usr/local/etc/renderd.conf"
RUNASUSER=tilesrv
Start renderd:
/etc/init.d/renderd start
Install Leaflet
Last but not least we need install some fancy slippy map on our webserver. We choose Leaflet.
It should be usable without internet, so we download it.
cd /var/www/html
wget https://unpkg.com/leaflet@1.0.1/dist/leaflet.js
wget https://unpkg.com/leaflet@1.0.1/dist/leaflet.css
Now we create our /var/www/html/index.html file which will display a leaflet map in fullscreen:
Full Screen Leaflet Map
<div id="map"></div>
Be sure to set the location in .setView, which is displayed first when visiting the site, to some tile with high zoomlevel which is available in your Map-Data.
Start everything
Restart all necessary services
/etc/init.d/postgresql restart
/etc/init.d/renderd restart
/etc/init.d/apache2 restart
Now everything is ready and you can browse to http://localhost
Be aware that the map will be very slow and you have to wait a few minutes for tiles with low zoomlevels. Don’t get impatient. Keep it open and wait. It will get faster over time when the server already rendered some tiles.
uriesk 
