yql / yql-tables Goto Github PK
View Code? Open in Web Editor NEWYQL is extensible using a table definition. This repository will hold community contributed definitions.
Home Page: http://developer.yahoo.com/yql
YQL is extensible using a table definition. This repository will hold community contributed definitions.
Home Page: http://developer.yahoo.com/yql
These calls were working earlier but now they have stopped working. Any idea when this could be fixed?
Sample output:-
{"query":{"count":1,"created":"2016-04-24T13:15:29Z","lang":"en-US","diagnostics":{"url":[{"execution-start-time":"0","execution-stop-time":"2","execution-time":"2","content":"http://www.datatables.org/yahoo/finance/yahoo.finance.incomestatement.xml"},{"execution-start-time":"4","execution-stop-time":"28","execution-time":"24","content":"http://finance.yahoo.com/q/is?s=T&quarterly"}],"publiclyCallable":"true","javascript":{"execution-start-time":"3","execution-stop-time":"30","execution-time":"26","instructions-used":"5014","table-name":"yahoo.finance.incomestatement"},"user-time":"31","service-time":"18","build-version":"0.2.438"},"results":{"incomestatement":{"symbol":"T","timeframe":"quarterly"}}}}
In short, the data is missing in the above calls. Can this be fixed please? A lot of people are looking for help on the yahoo finance table issues.
Hi,
As I understand, the currency data is supposed to be update every minute based.
I have been monitoring the data over the past few days. The feed rates seem to flit between the same 2 or 3 values throughout the day.
Out of interest - is this data still being maintained?
Thanks
I can't find finance datatables. Does this feature still exist ?
Digg Table must be moved to deprecated, or better still - removed since it's no longer available.
The community would be very grateful if there was an Open Table for Google Calendar.
How can this XML code be tested? I would be willing to help fix this.
"Exception: The content of elements must consist of well-formed character data or markup., url: http://finance.yahoo.com/q/ks?s=T",
Full error:
{
"query": {
"count": 0,
"created": "2014-08-27T05:08:33Z",
"lang": "en-US",
"diagnostics": {
"url": [
{
"execution-start-time": "0",
"execution-stop-time": "1",
"execution-time": "1",
"content": "http://www.datatables.org/yahoo/finance/yahoo.finance.keystats.xml"
},
{
"error": "Exception while converting tidy sanitized html to Dom",
"execution-start-time": "4",
"execution-stop-time": "127",
"execution-time": "123",
"http-status-code": "200",
"http-status-message": "OK",
"content": "http://finance.yahoo.com/q/ks?s=T"
}
],
"publiclyCallable": "true",
"javascript": [
"Exception: The content of elements must consist of well-formed character data or markup., url: http://finance.yahoo.com/q/ks?s=T",
{
"execution-start-time": "3",
"execution-stop-time": "127",
"execution-time": "123",
"instructions-used": "2000",
"table-name": "yahoo.finance.keystats"
}
],
"user-time": "127",
"service-time": "109",
"build-version": "0.2.2666"
},
"results": null
}
}
yahoo.finance.keystats just returns the symbol. The old xpath is:
var keystatsquery = y.xpath(
rawresult,
"//table[@Class='yfnc_datamodoutline1']/tr/td/table/tr" +
"/td[@Class='yfnc_tabledata1' or @Class='yfnc_tablehead1']"
);
I think it needs to be changed to:
var keystatsquery = y.xpath(
rawresult,
"//table[@Class='yfnc_datamodoutline1']/tbody/tr/td/table/tbody/tr" +
"/td[@Class='yfnc_tabledata1' or @Class='yfnc_tablehead1']"
);
it looks like there are tbody tags that are throwing it off. i haven't contributed to this project yet, and so i'm a little hesitant to make the change myself. can someone comment as to whether they agree with this?
Hi there,
I would like to amend the code around here so we can retrieve the full set of symbols that would be components of an index. For instance the ^FTAS has 662 components as of today but you can only get 51 back via YQL, if someone could give me some pointers on how to fix and test this I will make the changes and commit it back into the main repo.
API at https://github.com/yql/yql-tables/tree/master/twitter uses v1 (eg: https://github.com/yql/yql-tables/blob/master/twitter/twitter.status.timeline.public.xml).
Twitter has deprecated the API - https://dev.twitter.com/docs/api
The table must be updated to reflect v1.1
Do you want me to provide the patch? Will be happy to do it ๐
I got a bad request error when using the following query:
SELECT * FROM facebook.graph WHERE id='myeventid' and access_token='12xxxxxx74|a8a9d7ecxxxxxxx9464086|gN_mxxxxxxxxKXc81g.&offset=0&limit=10'
it looks like the problem is that pipe chars '|' in the access_token sent to facebook has been replaced by '%7c'.
cbfunc({
"query": {
"count": "0",
"created": "2010-08-07T10:18:02Z",
"lang": "en-US",
"diagnostics": {
"publiclyCallable": "true",
"url": [
{
"execution-time": "3",
"proxy": "DEFAULT",
"content": "http://www.datatables.org/facebook/facebook.graph.xml"
},
{
"execution-time": "389",
"http-status-code": "400",
"http-status-message": "Bad Request",
"proxy": "DEFAULT",
"content": "http://graph.facebook.com/myeventid?access_token=12xxxxxx74%7ca8a9d7ecxxxxxxx9464086%7cgN_mxxxxxxxxKXc81g.&offset=0&limit=10"
}
One reason for this is that using the old api http://twitter.com/statuses/user_timeline.xml?screen_name=erikvold&page=0&count=40 returns less than 40 records for some reason, but http://api.twitter.com/1/statuses/user_timeline.xml?screen_name=erikvold&page=0&count=40 works perfectly fine. Also the documentation for the old twitter api is hard to find now (you have to look through the history of hard to find pages), and there are minor differences between that old api documentation and the available documentation for the new api.
The date returned in "LastTradeDate" field should be in ISO8601 format like the other dates in YQL tables.
I'm trying to get an options chain but it looks like Yahoo Finance has changed the markup on their page which has broken these calls.
It looks like these are the two errors:
Exception while converting tidy sanitized html to Dom
The content of elements must consist of well-formed character data or markup., url: http://finance.yahoo.com/q/op?s=GOOG&m=2015-01
I was previously using yahoo.finance.options
in an old project and it did indeed used to work (early this year is the last time I had tested it).
Anyone know how I can fix this?
4 lines looks like they need to be corrected:
<key id="access_token" type="xs:stirng"
by
<key id="access_token" type="xs:string"
I've been using this table successfully for months. Today it stopped working.
Any symbol returns an empty set.
More details:
true
results.length(): 2
#90)]]>
1687
1428
25037
Thanks for the help
I started receiving this error today? Could someone please kindly explain what is the cause of this as my queries work in the YQL console but not anywhere else?
I notice they can be accessed in the yql console. YGroups is definitely outdates, the yahoo voices has some that are functioning, but as the author of those tables I must admit, a lack of maintenance, so the best thing would be to delete them. In the end, it isnt a big issue but I figure it needed to be said. I know some authors dont go back to address their old tables. So I figured I would.
When using the weather.woeid table, the unit parameter is ignored. The diagnostics show that the URL providing the woeid and the unit is not correct. For example, if the query is
select * from weather.woeid where w=2151330 and u="c"
the result will give the temperature in Fahrenheit (not in Celsius as asked). The diagnostics show the following URL:
h ttp://weather.yahooapis.com/forecastrss?w=&w=2151330&u=&u=c
There are two "w=" and two "c=". I guess it is the source of the problem.
the 'lang' parameter is optional according to http://code.google.com/p/socialmention-api/wiki/APIDocumentation, but presently the absence of it causes an error on the YQL console.
is there a way to see the current change in value for a currency pair?
it's present on yahoo finance's site, you think it would be in the api as well.
thanks
oquote doesn't retrieve any data
All yahoo.finance scripts are not working any more because Yahoo decided to roll out a design update.
Not sure where to report it, but Health Checker gives WSOD at: http://www.datatables.org/healthchecker/
I've tried to report it at forum, but the posting form doesn't load either: https://developer.yahoo.com/forums/#/post/discussion
in every browser when trying to add New Discussion (probably because of Firefox - 'Load denied by X-Frame-Options', Chrome - 'Refused to display' errors in JS console).
gives a columns mismatch (see output). This url works fine from the command line, but sometimes it fails for a couple of hours from my application. I think it has something to do with the & in column 'Change&PercentChange'
<url>http://www.datatables.org/yahoo/finance/yahoo.finance.quotes.xml</url><publiclyCallable>true</publiclyCallable><cache>5d1e1de680846a307c9874dc3d6878dc</cache>
<url>http://download.finance.yahoo.com/d/quotes.csv?f=aa2bb2b3b4cc1c3c4c6c8dd1d2ee1e7e8e9ghjkg1g3g4g5g6ii5j1j3j4j5j6k1k2k4k5ll1l2l3mm2m3m4m5m6m7m8nn4opp1p2p5p6qrr1r2r5r6r7ss1s7t1t7t8vv1v7ww1w4xy&s=AAPL</url>
<csv>Column mismatch: [Ask, AverageDailyVolume, Bid, AskRealtime, BidRealtime, BookValue, Change</csv>
<query>select * from csv where url=@url and columns='Ask,AverageDailyVolume,Bid,AskRealtime,BidRealtime,BookValue,Change&PercentChange,Change,Commission,Currency,ChangeRealtime,AfterHoursChangeRealtime,DividendShare,LastTradeDate,TradeDate,EarningsShare,ErrorIndicationreturnedforsymbolchangedinvalid,EPSEstimateCurrentYear,EPSEstimateNextYear,EPSEstimateNextQuarter,DaysLow,DaysHigh,YearLow,YearHigh,HoldingsGainPercent,AnnualizedGain,HoldingsGain,HoldingsGainPercentRealtime,HoldingsGainRealtime,MoreInfo,OrderBookRealtime,MarketCapitalization,MarketCapRealtime,EBITDA,ChangeFromYearLow,PercentChangeFromYearLow,LastTradeRealtimeWithTime,ChangePercentRealtime,ChangeFromYearHigh,PercebtChangeFromYearHigh,LastTradeWithTime,LastTradePriceOnly,HighLimit,LowLimit,DaysRange,DaysRangeRealtime,FiftydayMovingAverage,TwoHundreddayMovingAverage,ChangeFromTwoHundreddayMovingAverage,PercentChangeFromTwoHundreddayMovingAverage,ChangeFromFiftydayMovingAverage,PercentChangeFromFiftydayMovingAverage,Name,Notes,Open,PreviousClose,PricePaid,ChangeinPercent,PriceSales,PriceBook,ExDividendDate,PERatio,DividendPayDate,PERatioRealtime,PEGRatio,PriceEPSEstimateCurrentYear,PriceEPSEstimateNextYear,Symbol,SharesOwned,ShortRatio,LastTradeTime,TickerTrend,OneyrTargetPrice,Volume,HoldingsValue,HoldingsValueRealtime,YearRange,DaysValueChange,DaysValueChangeRealtime,StockExchange,DividendYield'</query><javascript></javascript><user-time>9</user-time><service-time>6</service-time><build-version>0.2.395</build-version></diagnostics><results></results></query>
fin.
https://github.com/yql/yql-tables/commits/master
As per the commit list, there were a great number of changes by Daniel Park were committed to master,. mostly containing random deletion of XML files (and really crippling a good number of APIs).
Are those commits to be rolled back? Thanks
When you query yahoo.finance.options, the volume and open interest fields are not correct for occasions when the amount is above 1000. There is a comma in the number for these instances and the code is just pulling the numbers up to the column. If you look at Google, you will be able to see this.
I'm getting this error while using ReadabilitySAX table.
Exception: TypeError: Cannot find function onopentag in object [object Object].
Thanks for help.
The tables define as "endpoint" for the request the "non secure" http adress : "http://api.twitter.com"
For sample ( from "twitter.directmessages.sent.xml" or "twitter.oauth.requesttoken.xml"
http://api.twitter.com/1/direct_messages/sent.{format}
The problem: twitter reject this queries becaus of using http instead of https.
The urls should be "rewritten" to add the "s" to the protokoll...
Thanks in advance.
The field 'name' returns an empty string. It'd be great if someone could take a look at this. Thank you!
I just tried the query below using an iPhone UA string, but the returned HTML content was still for the desktop version.
select * from {table} where url="http://www.amazon.com/" and ua="Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1"
The interesting thing is it worked (I got the mobile version) if I changed url
to http://www.yahoo.com/. Maybe some sites like Amazon is looking for another HTTP header that needs to be set in order for it to be identified as a mobile device?
I'm testing craigslist.search table at YQL Console and below are my results.
Testing Sample Query:
select * from craigslist.search where location="sfbay" and type="sss" and query="schwinn mountain bike"
It generates Forbidden (403), as well as for other queries.
Robot file seems ok and direct link works as expected.
Is the table broken, or it's some temporary glitch?
fin.
Strange issue - yahoo.finance data is a day old. Last trade date is a day old, open is from yesterday, current prices all wrong. It's like it is replaying yesterday play for play. A leap-year issue?
The yahoo.finance.sectors query isnt returning results.
I believe the structure of the html has changed here:
https://github.com/yql/yql-tables/blob/master/yahoo/finance/yahoo.finance.sectors.xml#L30
Hello!
I have a problem with request to xchange service.
Look at my request https://scrn.gbksoft.net/2cEKs-qe3ee3M8oeoaSTeQ.png , it does not work, but request from http - works correctly.
When error - i got response with next :({"error":{"lang":"en-US","description":"No definition found for Table yahoo.finance.xchange"}}.
Could you help me and give advice how to solve this issue?
Thank you in advance.
I am trying to get analyst estimation data using the YQL query:
select * from yahoo.finance.analystestimate where symbol='YHOO'
but the only thing returning is
{ "query": { "count": 1, "created": "2016-04-17T16:49:48Z", "lang": "de-DE", "results": { "results": { "symbol": "YHOO" } } }
I would expect some data about target price etc. Any help is really appreciated. There are also two open questions regarding this on stackoverflow, but noone seems to be able to answer this.
http://stackoverflow.com/questions/31588163/yql-yahoo-finance-analystestimate-results
https://stackoverflow.com/questions/36260484/are-the-yahoo-finance-related-data-apis-change-yql-console
Yesterday this were working fine.
https://developer.yahoo.com/yql/
select * from json where url="http://finance.yahoo.com/webservice/v1/symbols/TRPL4.SA,TRPL3.SA/quote?format=json" and itemPath = "list.resources.resource.fields"
Any ideia?
Thanks
Balance sheet returns nothing looks like balance sheet is broken
select * from yahoo.finance.dividendhistory where symbol = "KO" and startDate = "1962-01-01" and endDate = "2013-12-31"
Even using the example code results in an error. Running this query results in data after the endDate.
I had originally posted this under the yahoo.finance.balancesheet fix, but it appears that issue is closed and I wanted to ensure this issue is open. Apologies for the crosspost.
It appears yahoo.finance.balancesheet is broken. It's trying to pull on the below URL, which currently returns a 404.
http://finance.yahoo.com/q/?s=aapl&quarterly
Correct URL should be (example given for AAPL):
Quarterly:
http://finance.yahoo.com/q/bs?s=AAPL
Annually:
http://finance.yahoo.com/q/bs?s=AAPL&annual
I suspect CashFlow and IncomeStatement are also broken now too. If this gets fixed, I'll post on those respective files.
Would love a fix for this!
it seams that ip.location table is not working as http://ipinfodb.com/ has changed their api.
Now they request a key for the request, I'm not sure how to fix it, as if I added the key as a required parameter, I think it will break some of the implementations (which are already now borken), so if anybody can help with that
And I get the error from YQL: No definition found for Table data.headers.
Go to http://developer.yahoo.com/yql/console and enter the query
use "http://triplr.org/sparyql/sparql.xml" as sparql;
select * from sparql where query="PREFIX foaf: <http://xmlns.com/foaf/0.1/> SELECT $nick $name FROM <http://www.dajobe.org/foaf.rdf> WHERE { $x a foaf:Person . $x foaf:nick $nick . $x foaf:name $name }"
and service="http://triplr.org/sparql"
and get back a 500 error
Server Log:
209.131.41.48 - - [24/Jan/2010:20:43:47 -0800] "GET /sparql?query=PREFIX%20foaf%3A%20%3Chttp%3A//xmlns.com/foaf/0.1/%3E%20SELECT%20%24nick%20%24name%20FROM%20%3Chttp%3A//www.dajobe.org/foaf.rdf%3E%20WHERE%20%7B%20%24x%20a%20foaf%3APerson%20.%20%24x%20foaf%3Anick%20%24nick%20.%20%24x%20foaf%3Aname%20%24name%20%7D HTTP/1.0" 200 487 "-" "Yahoo Pipes 2.0"
which despite the apache log saying 200, it actually returns a 301 (permanent) redirect to:
http://triplr.org/sparql/PREFIX%20foaf%3A%20%3Chttp%3A%2F%2Fxmlns.com%2Ffoaf%2F0.1%2F%3E%20SELECT%20%24nick%20%24name%20FROM%20%3Chttp%3A%2F%2Fwww.dajobe.org%2Ffoaf.rdf%3E%20WHERE%20%7B%20%24x%20a%20foaf%3APerson%20.%20%24x%20foaf%3Anick%20%24nick%20.%20%24x%20foaf%3Aname%20%24name%20%7D
Server Log:
209.131.41.48 - - [24/Jan/2010:20:43:48 -0800] "GET /sparql/PREFIX%20foaf%3A%20%3Chttp%3A%2F%2Fxmlns.com%2Ffoaf%2F0.1%2F%3E%20SELECT%20%24nick%20%24name%20FROM%20%3Chttp%3A%2F%2Fwww.dajobe.org%2Ffoaf.rdf%3E%20WHERE%20%7B%20%24x%20a%20foaf%3APerson%20.%20%24x%20foaf%3Anick%20%24nick%20.%20%24x%20foaf%3Aname%20%24name%20%7D?query=PREFIX%20foaf%3A%20%3Chttp%3A//xmlns.com/foaf/0.1/%3E%20SELECT%20%24nick%20%24name%20FROM%20%3Chttp%3A//www.dajobe.org/foaf.rdf%3E%20WHERE%20%7B%20%24x%20a%20foaf%3APerson%20.%20%24x%20foaf%3Anick%20%24nick%20.%20%24x%20foaf%3Aname%20%24name%20%7D HTTP/1.0" 404 2454 "-" "Yahoo Pipes 2.0"
Notice "Yahoo Pipes 2.0" makes request
http://triplr.org/sparql?query=QUERY
and interprets the 301 response as:
http://triplr.org/sparql/QUERY?query=QUERY
Hi,
I hope this is the right place to create an issue (the developer forum seems dead, and said it was read-only).
I can issue the following query against yahoo.finance.quotes:
select * from yahoo.finance.quotes where symbol in ("ABBY.L")
I get an error when I issue this query:
select * from yahoo.finance.quotes where symbol in ("VMED.L")
You can get individual quotes from Yahoo for each of these symbols:
http://finance.yahoo.com/q?s=ABBY.L&ql=1
http://finance.yahoo.com/q?s=VMED.L&ql=1
Here's the links to see the results in the YQL console:
Is this a bug in the table definition? Or am I doing something wrong?
Hi. I've noticed that Spanish market quotes are not accesible. While US quotes (i.e. AAPL) or German quotes (i.e. DBK.DE) are OK, Spanish quotes such as SAN.MC (Santander) is not working. It always returns N/A data. Any idea about why this happens??? Thanks
When running http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20yahoo.finance.balancesheet%20where%20symbol%20%3D%20%22T%22&diagnostics=true&env=store%3A%2F%2Fdatatables.org%2Falltableswithkeys it shows that the generated URL is incorrect, I think you need to modify each of the script to force http://finance.yahoo.com/q//?s=....
<?xml version="1.0" encoding="UTF-8"?>
<query xmlns:yahoo="http://www.yahooapis.com/v1/base.rng" yahoo:count="0" yahoo:created="2013-10-08T01:24:37Z" yahoo:lang="en-US"><diagnostics><url execution-start-time="1" execution-stop-time="1" execution-time="0"><![CDATA[http://www.datatables.org/yahoo/finance/yahoo.finance.balancesheet.xml]]></url><publiclyCallable>true</publiclyCallable><url execution-start-time="5" execution-stop-time="10" execution-time="5" http-status-code="404" http-status-message="Not Found"><![CDATA[http://finance.yahoo.com/q/?s=T&quarterly]]></url><javascript execution-start-time="4" execution-stop-time="11" execution-time="6" instructions-used="5056" table-name="yahoo.finance.balancesheet"></javascript><user-time>11</user-time><service-time>2</service-time><build-version>0.2.1867</build-version></diagnostics><results/></query><!-- total: 11 -->
<!-- engine9.yql.gq1.yahoo.com -->
I originally posted a good version of yahoo.finance.stock. Then somehow an older corrupt version got merged in.
Now that I have more experience with the strange way that yql-tables is managed, I think what happened is:
(Or maybe it had something to do with the fact that I made my own readme and then later noticed this also got pulled back to the master. I notified someone, and this got fixed, but maybe in fixing that they somehow also got my earlier bad version of yahoo.finance.stock?)
Whatever. So about 4 years ago, I noticed all this and tried to get it fixed to no avail. At that point I was frustrated with yql-tables maintenance and gave up. Somewhat later, sh1mmer (who I don't know) managed to post my good code (you can see my name still in the metadata) as yahoo.finance.stocks (note the extra s).
Strangely(?) yahoo.finance.stock doesn't appear in https://github.com/yql/yql-tables/tree/master/yahoo/finance ??? If it did, I presume I could fork the current repo, delete it myself, and send in a pull request?
Back to the present. The other day I noticed this:
Some of the answers refer to my Yahoo Finance Open Data Tables. And one showed a technique I wasn't aware of that seems to avoid having to use oauth (which I asked a question about 4 years ago but never got an answer to) Sooo... I've become motivated to look at YQL again and see if it can solve the problem of getting all Yahoo Stock tickers.
I am in the process of updating all my finance Open Data Tables (and perhaps making new ones). Once I am done, I will fork the current tree, delete yahoo.finance.stocks, add my new fixed yahoo.finance.stock instead, and issue a pull request. Presumably doing that all within a few minutes will avoid the problem I had earlier (wherein I waited a week or two between forking and issuing a pull request)?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.