The newstrader from zrxbeijing

newstrader's People

Contributors

Stargazers

Watchers

newstrader's Issues

Commoncrawl

Hi, its me again, how do you use https://github.com/zrxbeijing/NewsTrader/blob/main/NewsTrader/newsfeed/commoncrawldatabase.py for specific websites:

Currently the get_news_from_domain piece of code does not work,

Thanks :)

Great project

Hi, I have been exploring your project, and I really like it! I have downloaded your repo to colab and attempted your following example


from NewsTrader.newsfeed.gdeltdatabase import GdeltDatabase
from NewsTrader.newsfeature import extract_title, extract_symbols

df = GdeltDatabase(date='2021-10-01', table='events').query()

df['title'] = extract_title(list(df.SOURCEURL), mode='url', check_english=False, num_process=16)
df = df.dropna(subset=['title']).reset_index(drop=True)

titles = list(df.title)
result = extract_symbols(titles,
                         min_score=0.65, 
                         min_similarity=0.80, 
                         only_preferred=False)

df['possible_symbols'] = [None if candidate_list is None else [candidate['symbol'] for candidate in candidate_list] for candidate_list in result]
df['company_names'] = [None if candidate_list is None else [candidate['long_name'] for candidate in candidate_list] for candidate_list in result]
df = df[['SOURCEURL', 'title',
       'possible_symbols', 'company_names']]

df = df.dropna(subset=['possible_symbols'])

I have tried numerous fixes, and I am unable to get any outputs, would love your recommendation on what to do from here.

Recommend Projects