kennyn510 / wpa2-wordlists Goto Github PK

Hi,
Using this command awk '!(count[$0]++)' old.txt > new.txt with huge dictionary is causing out of memory problem and command to be killed by the kernel.

[16346.370650] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-0.slice/session-5.scope,task=awk,pid=17277,uid=0
[16346.370669] Out of memory: Killed process 17277 (awk) total-vm:31343560kB, anon-rss:31336728kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:61380kB oom_score_adj:0
[16347.841088] oom_reaper: reaped process 17277 (awk), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB

root@kali:/Documents/wordlists/wpa2-wordlists/Wordlists# grep -R "text/javascript" */full5.txt
Major2016/full5.txt:at.type='text/javascript';
Ultimate2016/full5.txt:siuvinq529'...|topoftheox</title><scripttype="text/javascript"><--functionmm_settextoftextfield(objid,x,newtext){//v9.0with(document){if(getelementbyid){varobj=getelementbyid(objid):}if(obj)obj.value=newtext:}}functionmm_preloadimages(){//v3.0vard=document:if(d.images){if(d.mm_p)d.mm_p=newarray():vari,j=d.mm_p.length,a=mm_preloadimages.arguments:for(i=0:ia.length:i++)if(a[i].indexof("#")=0){d.mm_p[j]=newimage:d.mm_p[j++].src=a[i]:}}}//--</script><scriptsrc="../../scripts/ac_runactivecontent.js"type="text/javascript"></script><scripttype="text/javascript">vargajshost=(("https:"==document.location.protocol)"https://ssl.":"http://www."):document.write(unescape("%3cscriptsrc='"+gajshost+"google-analytics.com/ga.js'type='text/javascript'%3e%3c/script%3e")):</script><scripttype="text/javascript">try{varpagetracker=_gat._gettracker("ua-6594899-4"):pagetracker._trackpageview():}catch(err){}</script><scripttype="text/javascript"src="js/js_rotatingchart.js"></script><scripttype="text/javascript"src="js/js_chartselection.js"></script><scriptlanguage="javascript"type="text/javascript"><--functiontogglediv1(){document.getelementbyid('inc_chart_1').style.display='block':document.getelementbyid('inc_chart_2').style.display='none':document.getelementbyid('inc_chart_3').style.display='none':document.getelementbyid('inc_chart_4').style.display='none':document.getelementbyid('inc_chart_5').style.display='none':}functiontogglediv2(){document.getelementbyid('inc_chart_1').style.display='none':document.getelementbyid('inc_chart_2').style.display='block':document.getelementbyid('inc_chart_3').style.display='none':document.getelementbyid('inc_chart_4').style.display='none':document.getelementbyid('inc_chart_5').style.display='none':}functiontogglediv3(){document.getelementbyid('inc_chart_1').style.display='none':document.getelementbyid('inc_chart_2').style.display='none':document.getelementbyid('inc_chart_3').style.display='block':document.getelementbyid('inc_chart_4').style.display='none':document.getelementbyid('inc_chart_5').style.display='none':}functiontogglediv4(){document.getelementbyid('inc_chart_1').style.display='none':document.getelementbyid('inc_chart_2').style.display='none':document.getelementbyid('inc_chart_3').style.display='none':document.getelementbyid('inc_chart_4').style.display='block':document.getelementbyid('inc_chart_5').style.display='none':}functiontogglediv5(){document.getelementbyid('inc_chart_1').style.display='none':document.getelementbyid('inc_chart_2').style.display='none':document.getelementbyid('inc_chart_3').style.display='none':document.getelementbyid('inc_chart_4').style.display='none':document.getelementbyid('inc_chart_5').style.display='block':}//--></script><scriptsrc="spryassets/sprytooltip.js"type="text/javascript"></script><linkhref="spryassets/sprytooltip.css"rel="stylesheet"type="text/css"/><scriptsrc="spryassets/xpath.js"type="text/javascript"></script><scriptsrc="spryassets/sprydata.js"type="text/javascript"></script><scriptsrc="js/js_chartdata.js"type="text/javascript"></script><scriptlanguage="javascript"type="text/javascript">varnewwindow:functionpoptastic(url){newwindow=window.open(url,'name','height=150,width=192'):if(window.focus){newwindow.focus()}}</script><scriptsrc="http://cdn.jquerytools.org/1.1.0/jquery.tools.min.js"></script><scripttype="text/javascript">functiontimedmsg(){settimeout("togglediv2()",5000):}</script><linkhref="styles_2010.css"rel="stylesheet"type="text/css"/><styletype="text/css"><--h2{font-size:16px:color:#000000:height:10px:text-decoration:underline:}h5{font-size:10px:color:#ff0000:height:11px:}--></style><scripttype="text/javascript"src="js/wz_tooltip.js"></script><divclass="main_container"><divclass="container1"><divclass="container1_row1"><divclass="container1_row1_col1"><divclass="container1_row1_col2"><divclass="container1_row1_col2_row1"><divclass="container1_row1_col2_row1_col1"><divclass="container1_row1_col2_row1_col2"><divclass="container1_row1_col2_row2"><tableborder="0"cellspacing="0"cellpadding="0"><tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='news.asp#anchor'"><ahref="news.asp#anchor">home<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='chart.asp#chart'"><ahref="chart.asp#chart">chart<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='signup.asp#signup'"><ahref="signup.asp#signup">enter<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='news_more.aspid=46#anchor'"><ahref="news_more.aspid=46#anchor">reviews<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='gigs.asp#gigs'"><ahref="gigs.asp#gigs">gigs<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='catalogue.asp#anchor'"><ahref="catalogue.asp#anchor">allsongs<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='tv.asp#tv'"><ahref="tv.asp#tv">tv<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='winners20092010.asp#anchor'"><ahref="winners20092010.asp#anchor">winners<tdstyle="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:color:#000:background-image:url(images/button_blank.jpg):width:79px:height:34px:"onmouseover="this.style.backgroundimage='url(images/button_blank_over.jpg)':this.style.color='#ffffff'"onmouseout="this.style.backgroundimage='url(images/button_blank.jpg)':this.style.color='#2633a6'"onclick="window.location='sponsors.asp#sponsors'"><ahref="sponsors.asp#sponsors">sponsors<--<tdwidth="79"height="34"background="images/button_blank.jpg"style="font-family:'franklingothicmediumcond':font-size:12px:text-align:center:"><ahref="javascript:poptastic('radio/radio.asp'):">radio--><divclass="container1_row1_col2_row3"><imgsrc="images/spacer.gif"width="718"height="71"border="0"usemap="#map"/><mapname="map"id="map"><areashape="rect"coords="525,0,715,71"href="http://www.topoftheox.co.uk/site/sponsor_leave_chart.aspid=17"target="_blank"alt="starnow"/><areashape="rect"coords="405,0,525,71"href="http://www.topoftheox.co.uk/site/sponsor_leave_chart.aspid=21"target="_blank"alt="turanaudio"/><areashape="rect"coords="230,0,405,71"href="http://www.topoftheox.co.uk/site/sponsor_leave_chart.aspid=31"target="_blank"alt="marshallamplification"/><areashape="rect"coords="230,0,110,71"href="http://www.topoftheox.co.uk/site/sponsor_leave_chart.aspid=25"target="_blank"alt="sae"/><divclass="clear"><divclass="container2"><divclass="container2_col1"><divclass="container2_col1_row1"><divclass="container2_col1_row1_col1"><divclass="container2_col1_row1_col2"><ahref="sponsor_leave_banner.aspid=78"target="_blank"><imgsrc="../uploads/sponsors/musiciansreviews.jpg"border="0"onmouseover="tip('gearreviews')"onmouseout="untip()"/><divclass="container2_col1_row1_col3"><divclass="clear"><divclass="container2_col1_row2"style="background-image:url(images/topoftheox_v7_latest_sections.png):width:823px:height:280px:"><tablewidth="100%"border="0"cellspacing="0"cellpadding="0"><tdwidth="15"height="271"valign="top">&nbsp:<tdwidth="256"valign="top"><tablewidth="100%"border="0"cellspacing="0"cellpadding="0"><tdheight="35"><divstyle="font-family:tahoma,geneva,sans-serif:font-weight:bold:color:#fff:text-align:center:font-size:22px:">professionalreviews<divstyle="font-family:tahoma,geneva,sans-serif:font-weight:bold:color:#999:text-align:center:font-size:16px:">thatmakethedifference<tdheight="177"valign="top"><divstyle="margin-left:6px:font-family:tahoma,geneva,sans-serif:font-weight:bold:color:#fff:text-align:left:font-size:15px:"><olstyle="margin:1px:font-size:18px:line-height:37px:">

uploadyourmusictooursiteandreceievereviewsfromyourpeers.

ourunsignedchartshaveprovidedrecorddeals,sponsorshipandexposureforsomeofthehottestnewbandsaround.

https://github.com/kennyn510/wpa2-wordlists/blame/ae3cad1185d3a8aecc04e3bf0a9b475e5afefc7d/PlainText/logins.txt#L4891

I don't know if it's just me getting the issue with the gunzip and cat* The command is not recognised
I am just testing this out as a new developer. Any recommendations will be appreciated.

Download

WPA password is more than 8