This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 2: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for members service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/KnessetMembersData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

The Knesset Dataservice should provide an interface to get committee meeting details by id.

Currently, there is only a function for getting meetings data - the CommitteeAgendaSearch in the CommitteeScheduleData service (see http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/$metadata)

This function doesn't allow to get details of a specific meeting by it's id.

This issue was automatically created, please do not modify the title or remove any labels

testing one two three

for more details see: https://gist.github.com/OriHoch/9044514086971bd9b75e

The following URL should return committee protocols ordered by date descending:

http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/View_protocols?$orderby=Protocol_date%20desc

the latest protocol shown is from Oct. 2014

However, on Knesset website, newer protocols can be seen, e.g.:

http://main.knesset.gov.il/Activity/committees/Economics/Pages/CommitteeAgenda.aspx?tab=3&ItemID=573798

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 5: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for committees service

url=http://www.google.com/

error=request exception

error content...

Reproduction Steps (for votes)

• make a request to get votes data and add a filtering on the vote_date field
• for example: [http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=50&$filter=vote_date gt datetime'2014-01-01T00:00:00' and vote_date lt datetime'2014-02-01T00:00:00'](http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=50&$filter=vote_date gt datetime'2014-01-01T00:00:00' and vote_date lt datetime'2014-02-01T00:00:00')

Expected

• list of votes filtered according to the $filter
• in the above example, I expect to get votes between 01, Jan, 2014 and 01, Feb, 2014

Actual

• Error
• 
• 

Additional scenarios

• the same occurs with MMM data service - see comment by @alonisser below

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 571: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for committees service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

reproduction steps

• open url: http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/CommitteeAgendaSearch?FromDate=%272016-01-01T00:00:00%27

expected

• list of committee meetings since Jan 01, 2016

actual

• nothing is returned
  

this vote's time is 00:00

• http://www.knesset.gov.il/vote/heb/Vote_Res_Map.asp?vote_id_t=23567

but in dataservice, we get vote_time = null

• http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved(23567)

looking at another vote on that day, you can see time of 00:01

• http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved(23568)

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 6: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

change detected in metadata of committees service

url=http://www.google.com/

for more details see: https://gist.github.com/OriHoch/3183e5dd6c7a5329a75e

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 321: ('Connection aborted.', error(110, 'Connection timed out'))

Reproduction Steps

• Open vote id 22156 on Knesset website: http://www.knesset.gov.il/vote/heb/Vote_Res_Map.asp?vote_id_t=22156
• note the number of votes against is 4 (both in the total number and if you add up the separate votes)
• Open the same vote in DataService: [http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=20&$filter=vote_id eq 22156](http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=20&$filter=vote_id eq 22156)
• look at the value for "total_against" property

Expected

• total against should be 4 (as it is on the website)

Actual

• total against is 3
• 

User Story

Jack is a statistician that wants to do some research on the votes of the knesset. He searches google for knesset votes data and finds the knesset-data project. He uses the python apis to get all the raw data of votes he required for his researchh. He publishes his research based on the findings

Expected

• Jack will achieve praise for his wonderful research

Actual

• Jack will be scorned by his peers because he misused the data.
• Jack assumed that the field "total_against" contains the total number of members that voted against.
• However - if Jack would have searched in the knesset-data issues he would have found issue #22 which mentions that total_against field is actually wrong in many cases.

Description

We should have good documentation of the meaning of the data. This should not include just how to use the APIs but should give a description of the data - where the data is coming from, what's the meaning of the data, how often it's updated etc..

An example of such a documentation:

https://github.com/hasadna/knesset-data/blob/master/python/knesset_data/dataservice/VOTES.md

See Also

• #31 - add sphinx docs

Reproduction steps

• go to: [http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=20&$orderby=vote_date desc](http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc/View_vote_rslts_hdr_Approved?$top=20&$orderby=vote_date desc)

Expected

• list of votes ordered by vote_date descending

Actual

• Error
• 
• 

Notes

• This worked until a few days ago

the knesset services have a /$metadata file which contains some more content, should check it out and find new stuff:

e.g:
http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/$metadata

it can be browsed and viewed using http://pragmatiqa.com/xodata/

for example:
http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/CommitteeAgendaSearch?CommitteeId=%271%27&FromDate=%272016-01-01T00:00:00%27

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 574: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for messages service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/KnessetMessagesData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 19: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 10: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for final_laws service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/FinalLawsData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

User Story

Open Knesset periodically (every night) gets votes data form The Knesset using the Knesset Dataservice.

On March. 2 there was a problem on Knesset side which caused votes api to stop working

Expected

• On March.3 - Open Knesset developers team are notified of the problem. They proceed to investigate and notify Knesset about the problem.

Actual

• Open Knesset developers were notified about the problem only on March.28 when someone manually noticed there is a problem (see hasadna/Open-Knesset#642)

Description

should have a process that periodically (daily) checks the knesset dataservice services and automatically open new issues if problems are encountered

it should check:

• general availability of the service
• that latest data is returned
• that returned data is valid

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 266: ('Connection aborted.', error(110, 'Connection timed out'))

אהלן,
ההצבעות בכנסת פתוחה ישנות יחסית. החדשות ביותר הן מהשני בחודש מרץ.
עד כמה שהבנתי יש בעיה בגריפת המידע מאתר הכנסת. האם ההצבעות החדשות יעלו לאתר כנסת פתוחה?
תודה,
חובב
המשמר החברתי

When trying the api for vie lobbyist represent

http://online.knesset.gov.il/WsinternetSps/KnessetDataService/LobbyistData.svc/View_lobbyist_represent/

I get for example:

m:properties>
                <d:lobbyist_represent_id m:type="Edm.Int32">14821531</d:lobbyist_represent_id>
                <d:lobbyist_id m:type="Edm.Int32">205</d:lobbyist_id>
                <d:lobbyist_represent_name>??????</d:lobbyist_represent_name>
                <d:lobbyist_represent_domain>????÷??</d:lobbyist_represent_domain>
                <d:lobbyist_represent_type>÷???</d:lobbyist_represent_type>

            </m:properties>

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for mmm service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/MMMData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 4: ('Connection aborted.', error(110, 'Connection timed out'))

Reproduction steps

• open URL: http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/CommitteeAgendaSearch?CommitteeId=%27572%27&FromDate=%272016-01-01T00:00:00%27

expected

• meetings of committee 572 (הוועדה המיוחדת לדיון בהצעת חוק הרשות הממשלתית להתחדשות עירונית ובהצעת חוק שירותים פיננסיים חוץ מוסדיים)

actual

• error
  

it was available at this url:

• http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/View_protocols

now it returns an error, also, it disappeared from the service description:

• http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 33: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 536: ('Connection aborted.', error(110, 'Connection timed out'))

http://online.knesset.gov.il/WsinternetSps/KnessetDataService/

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 558: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for votes service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/VotesData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 11: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created, please do not modify the title or remove any labels

Unexpected exception received while trying to get meetings of committee 8: ('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for bills service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/BillsData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

This issue was automatically created by the knesset-data health monitor, please do not modify the title or remove any labels

unexpected error while trying to fetch metadata for lobbyists service

url=http://online.knesset.gov.il/WsinternetSps/KnessetDataService/LobbyistData.svc

error=request exception

('Connection aborted.', error(110, 'Connection timed out'))

need to research the latest knesset API and see if there is data about MMM documents, this should be documented in https://github.com/hasadna/knesset-data/tree/master/docs/dataservice

alternatively - look for other sources for MMM data

once we have the documentation of how to get MMM data - can move forward to implement code that fetches it in knesset-data-python

Specifically, we need to get MMM documents related to committee meetings

related issues

• hasadna/Open-Knesset#566

This issue was automatically created, please do not modify the title or remove any labels

Reproduction steps

• open URL: http://online.knesset.gov.il/WsinternetSps/KnessetDataService/CommitteeScheduleData.svc/CommitteeAgendaSearch?CommitteeId=%27572%27&FromDate=%272016-01-01T00:00:00%27

expected

• meetings of committee 572 (הוועדה המיוחדת לדיון בהצעת חוק הרשות הממשלתית להתחדשות עירונית ובהצעת חוק שירותים פיננסיים חוץ מוסדיים)

actual

• error
  

notes

• Unexpected exception received while trying to get meetings of committee 572: [Errno 104] Connection reset by peer

hello world

for example trying the following (url encoded) url:

http://online.knesset.gov.il/WsinternetSps/KnessetDataService/MMMData.svc/View_documents?orderBy=doc_date+desc&skip=0&top=10&%24select=doc_abstract%2Cdoc_date%2Cdoc_id%2Cdoc_link%2CDocumentsDocumentClient&%24expand=DocumentsDocumentClient

Completely valid odata request and validated with xodata

fails 8 out 10 times and sometimes all the time (for example 5.3.16 19:00 Israel time)
When trying without any params it does work quite consistently.

Interesting Info that might be connected to the issue: dataServiceVersion header is different with mmm then from Votes and Meetings. returns 2.0 and not 1.0 as the Votes And Meetings APIs.

Blocks adding mmm data #24

Currently Hamishmar votes data csv file contains a list of member names

This is a problem because the spelling they use is different then Knesset spelling.

Hamishmar will do a change on their side which will allow them to export the member IDs (same as the official Knesset ID which is the same as the Open Knesset Member ID as well)

Update (May.10) - we got the updated format, see the comment below

the VotesData.svc/vote_rslts_kmmbr_shadow entity is supposed to show which member voted on which vote. But there is only a member id which appears like it's not linked to anywhere.

This entity should contain a field with member_id relating to KnessetMembersData.svc/View_mk_individual