{"id":2553,"date":"2016-11-23T18:07:47","date_gmt":"2016-11-24T02:07:47","guid":{"rendered":"http:\/\/blog.light42.com\/wordpress\/?p=2553"},"modified":"2017-01-04T10:38:26","modified_gmt":"2017-01-04T18:38:26","slug":"osm-fresno","status":"publish","type":"post","link":"http:\/\/blog.light42.com\/wordpress\/?p=2553","title":{"rendered":"OSM Fresno"},"content":{"rendered":"

In Openstreetmap US, California Fresno area, a controversial [0] series of imports of legal property records (aka PARCEL) are mixed in with other POLYGONS. Many various POLYGON in Fresno now share the tag landuse=residential<\/code>, both the PARCEL legal records and real building footprint POLYGON, as well as various others. After reviewing the wiki talk page, relevant discussions, and discussing online briefly, this post looks at the OSM context; estimates the extent of these imports by examining similar, nearby areas; compares the OSM records to actual current PARCEL records; proposes a deletion criteria<\/strong> and finally, examines the extent of the proposed deletion.<\/p>\n

[0] changeset\/26356220<\/a> * changeset\/26357831<\/a>
\nOSM Wiki on Parcels -LINK-<\/a> -TALK-<\/a><\/p>\n

\n

Context: Fresno County<\/strong> is big — but the real-world residential areas are confined almost entirely to the City of Fresno. <\/p>\n

\"fresno_ccd_context\"<\/a><\/p>\n

\"fresno_landuse_context\"<\/a><\/p>\n

\"nlcd_06_legend\"
\nNLCD 06 mrlc.gov<\/a><\/p>\n

\n
\r\nQ. What tag 'landuse' values are present in County Subdivision Fresno?\r\n\r\n 151670 | residential\r\n   6644 | commercial\r\n   6463 | NULL\r\n   3859 | industrial\r\n    706 | farm\r\n    574 | vineyard\r\n    498 | orchard\r\n    453 | meadow\r\n    109 | garages\r\n\r\nless than 100: \r\n  basin,farmyard,recreation_ground,grass,farmland,religious,cemetery,retail,\r\n  quarry,reservoir,railway,landfill,construction,institutional\r\n<\/pre>\n
Next, expand the query to the entire five-county region<\/p>\n
\r\nQ. What tag 'landuse' values are present in the five county area \r\n-- Kings, Madera, Tulare, Kern, Fresno\r\n\r\n 207902 | NULL\r\n 203000 | residential\r\n  11697 | commercial\r\n   7054 | farm\r\n   6679 | orchard\r\n   5941 | industrial\r\n   5251 | vineyard\r\n   5029 | meadow\r\n   2475 | farmland\r\n   1980 | farmyard\r\n    885 | grass\r\n    \r\nless than 300: \r\n   garages,cemetery,recreation_ground,basin,quarry,reservoir,religious,retail\r\n  forest,scrub,military,landfill,railway,pond,greenhouse_horticulture,construction\r\n\r\n<\/pre>\n
So, 150,000 of the 200,000 landuse=residential<\/code> tagged POLYGONs in a five-county area, are in just the Fresno City CCD. <\/p>\n
Attribution<\/strong> On inspection, a large number of likely PARCEL records in Fresno, carry an attribution<\/code> tag with one of several recognizable values:  Caltrans (4), FMMP (3) and Fresno_County_GIS<\/strong>.<\/p>\n
\r\nexample data:\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"vineyard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"field_cropland\", \"type\"=>\"multipolygon\", \"landuse\"=>\"farm\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"field_cropland\", \"type\"=>\"multipolygon\", \"landuse\"=>\"farm\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"native_pasture\", \"type\"=>\"multipolygon\", \"landuse\"=>\"meadow\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"native_pasture\", \"type\"=>\"multipolygon\", \"landuse\"=>\"meadow\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"vineyard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"field_cropland\", \"type\"=>\"multipolygon\", \"landuse\"=>\"farm\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"vineyard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"crop\"=>\"field_cropland\", \"type\"=>\"multipolygon\", \"landuse\"=>\"farm\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"trees\"=>\"orange_trees\", \"landuse\"=>\"orchard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"residential\", \"lot_type\"=>\"single family residential properties\", \"other_use\"=>\"S\", \"attribution\"=>\"Fresno_County_GIS\", \"primary_use\"=>\"000\", \"secondary_use\"=>\"VLM\"\r\n \"type\"=>\"multipolygon\", \"wood\"=>\"mixed\", \"landuse\"=>\"farm\", \"natural\"=>\"wood\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"vineyard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n \"type\"=>\"multipolygon\", \"landuse\"=>\"orchard\", \"attribution\"=>\"Fresno_County_GIS\"\r\n<\/pre>\n
\n
Detailed counts in Fresno County and the Fresno CCD<\/p>\n
-- Fresno County:  geoid  06019 \/ tl_2016_us_county\r\n241860 - all multipolygons\r\n231624 - tag landuse\r\n196017 - tag landuse = 'residential'\r\n230685 - tag 'attribution'\r\n230612 - tag 'attribution' ~* 'GIS'\r\n----------------------------------------------------\r\n-- Fresno CCD:   geoid   0601991080\r\n171200 - all multipolygons\r\n164737 - tag landuse\r\n151670 - tag landuse = 'residential'\r\n166163 - tag 'attribution'\r\n166147 - tag 'attribution' ~* 'GIS'\r\n----------------------------------------------------\r\n-- Fresno County outside of Fresno CCD (derived)\r\n 70660 - all multipolygons   (241860 - 171200)\r\n 66887 - tag landuse         (231624 - 164737)\r\n 44347 - tag landuse = 'residential'  (196017 - 151670)\r\n 64465 - tag 'attribution' ~* 'GIS'   (230612 - 166147)\r\n<\/pre>\n
Qry - count the occurances of attribution 'GIS'   AND\r\n  landuse = 'residential'; area Fresno County, by cousub\r\n           name           | count  \r\n--------------------------+--------\r\n Caruthers-Raisin City    |   1400\r\n Fresno                   | 150681\r\n Kerman                   |   4093\r\n Reedley                  |   5967\r\n Mendota                  |   1779\r\n San Joaquin-Tranquillity |   1030\r\n Coalinga                 |   2528\r\n Firebaugh                |   1152\r\n Orange Cove              |   1579\r\n Kingsburg                |   3557\r\n Huron                    |     87\r\n Fowler                   |   1527\r\n Sierra                   |    963\r\n Parlier-Del Rey          |   2633\r\n Sanger                   |   7796\r\n Riverdale                |   1208\r\n Laton                    |    599\r\n Selma                    |   6221\r\n\r\n<\/pre>\n
\n
Compare current parcel data (670 records) to OSM multipolygon with tag landuse=residential<\/code> (350 records), in a sample Fresno blockgroup ('060190045051'<\/code>)
\nBBOX=\"-119.7994,36.8084,-119.7903,36.8229\"<\/code><\/p>\n
\"bg_fresno_0\"<\/p>\n
\"m_p_fresno_bg_0\"<\/a><\/p>\n
\"p_fresno_bg_0\"<\/a><\/p>\n
\"m_fresno_bg_0\"<\/a><\/p>\n
\n
This looks promising: take all OSM multipolygons marked landuse=residential<\/code>, then remove WHERE tag attribution<\/code> exists AND tag building<\/code> does not exist …<\/p>\n
\"osm_fresnocs_mpoly_landuse_res_attr0\"<\/a><\/p>\n
\"osm_fresnocs_mpoly_landuse_res1\"<\/a><\/p>\n
\"osm_fresnocs_mpoly_landuse_res0\"<\/a><\/p>\n
Some Links:<\/em>
\nhttps:\/\/help.github.com\/articles\/mapping-geojson-files-on-github\/<\/p>\n
\"fresno_parcels_osm_ex1\"<\/a><\/p>\n
\r\n-- County of Fresno, subdivision Fresno geoid = '0601991080'\r\n--  multipolygons m is a raw dot-pbf import of OSM\r\n\r\n-- Qry - Show all landuse tags and a count of occurances\r\n--   area: Fresno CCD\r\n--\r\nselect count(*), all_tags -> 'landuse'  \r\nFROM multipolygons m,  tl_2016_06_cousub cs\r\nWHERE\r\n    cs.geoid = '0601991080'  AND\r\n    st_intersects( m.wkb_geometry, cs.geom) \r\nGROUP BY all_tags -> 'landuse' \r\nORDER BY  all_tags -> 'landuse';\r\n\r\n\/* count |   landuse tag    \r\n--------+-------------------\r\n     48 | basin\r\n     11 | cemetery\r\n   6644 | commercial\r\n      1 | construction\r\n    706 | farm\r\n     24 | farmland\r\n     43 | farmyard\r\n    109 | garages\r\n     28 | grass\r\n   3859 | industrial\r\n      1 | institutional\r\n      1 | landfill\r\n    453 | meadow\r\n    498 | orchard\r\n      2 | quarry\r\n      1 | railway\r\n     37 | recreation_ground\r\n     19 | religious\r\n      2 | reservoir\r\n 151670 | residential\r\n      6 | retail\r\n    574 | vineyard\r\n   6463 | \r\n*\/\r\n\r\n--=====================================================\r\n--\r\n--  Kern County - FIPS 029\r\n--  Fresno County - FIPS 019\r\n--\r\n\r\n-- Qry - Show CCDs and a count of tag landuse = 'residential'\r\n--   area: Fresno County, Kern County\r\n--\r\nselect count(*), (cs.geoid, cs.name, cs.countyfp)\r\nFROM multipolygons m, tl_2016_06_cousub cs\r\nWHERE\r\n    cs.countyfp IN ( '019', '029' )  AND\r\n    all_tags -> 'landuse' = 'residential'  AND\r\n    st_intersects( m.wkb_geometry, cs.geom) \r\nGROUP BY  (cs.geoid, cs.name, cs.countyfp)\r\nORDER BY   (cs.geoid, cs.name, cs.countyfp) ;\r\n\r\n\/*\r\n   1408 | (0601990390,\"Caruthers-Raisin City\",019)\r\n   2558 | (0601990530,Coalinga,019)\r\n   1170 | (0601991000,Firebaugh,019)\r\n   1541 | (0601991060,Fowler,019)\r\n 151670 | (0601991080,Fresno,019)\r\n           ...............\r\n     60 | (0602990130,Arvin-Lamont,029)\r\n    724 | (0602990180,Bakersfield,029)\r\n          ................\r\n   1096 | (0602993320,Tehachapi,029)\r\n    188 | (0602993570,Wasco,029)\r\n    715 | (0602993635,\"West Kern\",029)\r\n*\/\r\n\r\n--==================================================\r\n--\r\n-- Qry - Show all landuse tags and a count of occurances\r\n--   area: Fresno County, Kern County\r\n----\r\nselect count(*), all_tags -> 'landuse'  \r\nFROM multipolygons m, tl_2016_06_cousub cs\r\nWHERE\r\n    cs.countyfp IN ( '019', '029' )  AND\r\n    st_intersects( m.wkb_geometry, cs.geom) \r\nGROUP BY all_tags -> 'landuse' \r\nORDER BY  all_tags -> 'landuse';\r\n\r\n\/* count |  landuse tag        \r\n--------+-------------------------\r\n      1 | aerodrome\r\n     83 | basin\r\n     54 | cemetery\r\n  11107 | commercial\r\n      1 | conservation\r\n      1 | construction\r\n   5160 | farm\r\n   2426 | farmland\r\n   1034 | farmyard\r\n      5 | forest\r\n    268 | garages\r\n    885 | grass\r\n      1 | greenhouse_horticulture\r\n   5830 | industrial\r\n      1 | institutional\r\n      3 | landfill\r\n   3318 | meadow\r\n      4 | military\r\n   6519 | orchard\r\n     45 | quarry\r\n      3 | railway\r\n     86 | recreation_ground\r\n     19 | religious\r\n     19 | reservoir\r\n 201341 | residential\r\n     13 | retail\r\n     16 | scrub\r\n   5225 | vineyard\r\n 203195 | \r\n*\/\r\n\r\n--===================================================\r\n--\r\n-- Qry - Show all landuse tags and a count of occurances\r\n--   area: Bakersfield city, Kern County (similar to Fresno city )\r\n--\r\n\r\nselect count(*), all_tags -> 'landuse'  \r\nFROM multipolygons m, tl_2016_06_place p\r\nWHERE\r\n    p.namelsad = 'Bakersfield city'  AND\r\n    st_intersects( m.wkb_geometry, p.geom) \r\nGROUP BY all_tags -> 'landuse' \r\nORDER BY  all_tags -> 'landuse';\r\n\r\n\/* count |   landuse tag\r\n--------+-------------------\r\n      4 | cemetery\r\n    687 | commercial\r\n     78 | farm\r\n      3 | farmland\r\n     23 | farmyard\r\n    836 | grass\r\n    261 | industrial\r\n     52 | meadow\r\n     18 | orchard\r\n      1 | railway\r\n      8 | recreation_ground\r\n    710 | residential\r\n     16 | scrub\r\n 119669 | \r\n*\/\r\n\r\n--===================================================\r\n--\r\n-- Qry - Show all landuse tags and a count of occurances\r\n--   area: Fresno City\r\n--\r\n--\r\nselect count(*), all_tags -> 'landuse'  \r\nFROM multipolygons m, tl_2016_06_place p\r\nWHERE\r\n    p.namelsad = 'Fresno city'  AND\r\n    st_intersects( m.wkb_geometry, p.geom) \r\nGROUP BY all_tags -> 'landuse' \r\nORDER BY  all_tags -> 'landuse';\r\n\r\n\/* count |   landuse tag\r\n--------+-------------------\r\n     25 | basin\r\n      5 | cemetery\r\n   5523 | commercial\r\n      1 | construction\r\n     67 | farm\r\n      4 | farmland\r\n      4 | farmyard\r\n     65 | garages\r\n     12 | grass\r\n   2410 | industrial\r\n      1 | landfill\r\n    268 | meadow\r\n     45 | orchard\r\n      1 | railway\r\n     26 | recreation_ground\r\n     19 | religious\r\n      1 | reservoir\r\n 105930 | residential\r\n      5 | retail\r\n     15 | vineyard\r\n   5192 | \r\n*\/\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"
In Openstreetmap US, California Fresno area, a controversial [0] series of imports of legal property records (aka PARCEL) are mixed in with other POLYGONS. Many various POLYGON in Fresno now share the tag landuse=residential, both the PARCEL legal records and real building footprint POLYGON, as well as various others. After reviewing the wiki talk page, […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14,5,6],"tags":[],"_links":{"self":[{"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/2553"}],"collection":[{"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2553"}],"version-history":[{"count":49,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/2553\/revisions"}],"predecessor-version":[{"id":2782,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/2553\/revisions\/2782"}],"wp:attachment":[{"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2553"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2553"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/blog.light42.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2553"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}