内容简介：It is my belief that perhaps the single most effective way we can make concrete progress toward this goal is in the realm of data accessibility. Specifically the accessibility of granular, local, county level police citation data.This however, is a big und
Police Data Accessibility Project
Rough Mission Statement (will evolve):
It is my belief that perhaps the single most effective way we can make concrete progress toward this goal is in the realm of data accessibility. Specifically the accessibility of granular, local, county level police citation data.
This however, is a big undertaking, as most counties have clumsy/antiquated systems for searching for and extracting this type of data, and almost none have fully exposed datasets.
Ultimately, the future goal for this initiative is to:
Request (via FOIA) or Scrape, and then clean and aggregate county level police citation data for as many counties as possible, and to most importantly make this data open and free to the public. I believe doing so will enable citizen data scientists and data journalists to then make progress on analysis, whereby they will serve the public by looking for and finding trends and anomalies in police behavior, leading to more accountability for both individual police officers and their larger police organizations.
Initial Goals:
Scraping:
-
Many counties outsource their court records data to third party vendors such as Tyler Technologies. Finding and building scrapers for portals that are the same for many counties seems like a great early goal. A list of counties court record systems and their vendors must be made. This will be done collaboratively in this Google Sheet . For more details see https://github.com/Police-Data-Accessibility-Project/Police-Data-Accessibility-Project/issues/6 .
-
Finding and writing scrapers for other large counties. Prioritize counties with easier to scrape systems first.
For guidelines to contributing to scraping, please see https://github.com/Police-Data-Accessibility-Project/Police-Data-Accessibility-Project/blob/master/CONTRIBUTING.md
Freedom of Information Act Requests:
-
Researching a data request template with all the data we want to ask for in FOIA requests
-
Submitting FOIA requests and monitoring responses
I will be adding tasks to the projects section of this repo, so we can all keep track of them there.
If you are looking to start building a scraper, the csv file above has the URLS of all most US counties' public records portals.
The fields we would like to make sure to collect at a minimum from any scrape are:
_id _state _county CaseNum FirstName MiddleName LastName Suffix DOB Race Sex ArrestDate FilingDate OffenseDate DivisionName CaseStatus DefenseAttorney PublicDefender Judge ChargeCount ChargeStatute ChargeDescription ChargeDisposition ChargeDispositionDate ChargeOffenseDate ChargeCitationNum ChargePlea ChargePleaDate ArrestingOfficer ArrestingOfficerBadgeNumber
以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持 码农网
本站部分资源来源于网络，本站转载出于传递更多信息之目的，版权归原作者或者来源机构所有，如转载稿涉及版权问题，请联系我们。
Spark大数据分析技术与实战
董轶群、曹正凤、赵仁乾、王安 / 电子工业出版社 / 2017-7 / 59.00
Spark作为下一代大数据处理引擎，经过短短几年的飞跃式发展，正在以燎原之势席卷业界，现已成为大数据产业中的一股中坚力量。 《Spark大数据分析技术与实战》着重讲解了Spark内核、Spark GraphX、Spark SQL、Spark Streaming和Spark MLlib的核心概念与理论框架，并提供了相应的示例与解析。 《Spark大数据分析技术与实战》共分为8章，其中前4......一起来看看 《Spark大数据分析技术与实战》 这本书的介绍吧!
