UCRAWLER HELP CENTER
How uCrawler works

uCrawler automatically scrapping articles from selected by you news sources.
Get all collected data via API, XML or directly in your DataBase.
The Two-Step Process for getting news articles
1
Add Groups and Sources
uCrawler allows you to create any Groups, e.g. Tech, Sport, Politics etc. with any news sources you want quickly & without hassle.

You just need to point on desired news blocks on a webpage with the visual selector or use RSS link.

Let uCrawler AI Extractors do all the work. Voila!
2
Get parsed data with API
uCrawler uses clever Spiders that automatically gathers news articles from your sources every 5 minutes. You can start / stop Spider in your Dashboard at any time.

Get collected data that included normalized HTML and plaintext, related images and more using uCrawler API or with automatic export directly to your Database or ElasticSearch.
{
"pub_time":1552428085
"group":"Tech"
"html_text":"<video controls poster><source src="https://i.kinja-img.com/gawker-media/image/upload/s--xTifwvkG--/c_fit,fl_progressive,q_80,w_636/jpjn3jyrcy3gg4tw27u5.mp4" /></video><p>We see a lot of deals around the web over on <a href="https://kinjadeals.theinventory.com">Kinja Deals</a>, but these were our ten favorites today.<br></p> <p>Head over to our <a href="https://kinjadeals.theinventory.com/tuesdays-best-deals-philips-hue-sony-4k-tv-clarks-a-1833229540?ks=curation">main post</a> for more deals, and follow us on <a href="http://twitter.com/kinjadeals">Twitter</a> and <a href="http://facebook.com/kinjadeals">Facebook</a> to never miss a chance to save. You can also join our <a href="http://facebook.com/groups/kinjadeals">Kinja Deals Community Facebook group</a> to connect with your fellow deal hunters.</p> <h3>#1 Sony 4k tv</h3> <p>Amazon has a S<a href="https://www.amazon.com/Sony-XBR60X830F-60-Inch-Ultra-Smart/dp/B07CXDY7G1/?tag=kinjadeals-20&amp;ascsubtag=7ed6d86907c3ee673e37906294b60f216a3d0e24">ony 60-inch smart 4K TV for under $800 right now</a>, as part of its Gold Box. This LED unit offers lots of the features you’d want in a TV, such as HDR10, Alexa compatibility and Chromecast built-in, and a 120hz refresh rate. Better still, this current price about $350 off its average price.</p> <h3>#2 refurb roomba</h3> <p>Woot’s discounting the powerful <a href="http://www.anrdoezrs.net/links/8335291/type/dlg/https://www.woot.com/offers/irobot-roomba-860-robotic-vacuum">Roomba 860</a> down to just $275 for a refurb. While it is still quite a bit more expensive than, say, the <a href="https://www.amazon.com/Self-Charging-Drop-Sensing-Technology-Allergens-Designed/dp/B01LYCLS24/ref=sr_1_sc_1?ie=UTF8&amp;qid=1498069684&amp;sr=8-1-spell&amp;keywords=eufy+roboavc&amp;tag=kinjadeals-20&amp;ascsubtag=4480c6a41b5d5e1243918db05558dc195ec40deb">Eufy RoboVac 11</a>, it boasts up to five times the sucking power of the comparable Roomba 650, so if you have kids or pets that tend to track in a lot of dirt, it might be worth the premium.</p> <p>You can schedule a cleaning 7x during the week and it’ll navigate around furniture and avoid stairs. This Roomba will automatically dock and recharge, too, which is super convenient.</p> <h3>#3 nintendo switch bundle</h3> <p>Walmart’s letting you build your own <a href="http://linksynergy.walmart.com/deeplink?id=xzXATABADTI&amp;mid=2149&amp;u1=kinjadeals-&amp;murl=https%3A%2F%2Fwww.walmart.com%2Fco%2F702870636">Nintendo Switch bundle </a>for just $330. Choose a console, either the neon blue/red or the gray Joy-Cons and a Mario game (<em>Mario Kart 8 Deluxe, New Super Mario Bros U Deluxe, Super Mario Odyssey, Mario Tennis Aces </em>or <em>Super Mario Party), </em>and Walmart will throw in some sweet pins and a less-sweet, designated guest controller.</p> <p>If you’ve been putting off buying a Switch... well, dude. I mean, come on.</p> <h3>#4 clarks</h3> <p>At the intersection of “cute” and “comfortable,” you will find <a href="http://www.anrdoezrs.net/links/8335291/type/dlg/sid/kinjadeals-/https://www.clarksusa.com/shoe-sale">Clarks</a>. And right now, the footwear brand is taking up to 60% off clearance items for <a href="http://www.anrdoezrs.net/links/8335291/type/dlg/sid/kinjadeals-/https://www.clarksusa.com/shoe-sale/mens-sale/c/us59">men</a>, <a href="http://www.anrdoezrs.net/links/8335291/type/dlg/sid/kinjadeals-/https://www.clarksusa.com/shoe-sale/womens-sale/c/us68">women</a>, and <a href="http://www.anrdoezrs.net/links/8335291/type/dlg/sid/kinjadeals-/https://www.clarksusa.com/shoe-sale/kids-sale/c/us58">kids</a>, plus an extra 20% off your clearance purchase with <strong>promo code OUTLET</strong>. Treat your feet to new boots, loafers, slip-ons, and more from this shoo-in of a sale before it’s over.</p> <h3>#5 anker projectors</h3> <p>If you want to <a href="https://theinventory.com/its-never-been-cheaper-to-build-a-projector-focused-hom-1831875960#_ga=2.115301191.111474295.1548374619-239710550.1544887007">build a budget, projector-based home theater</a>, the <a href="https://www.amazon.com/Anker-Multimedia-Projector-Horizontal-Keystoning/dp/B07GKJH76J/?tag=kinjadeals-20&amp;ascsubtag=ddd2c9cf55295cce61a949cfd33b897314246f2e">Prizm II is a good one to consider</a>, and right now you can get it for just $189 thanks to Amazon’s Gold Box.</p> <p>It’s the <a href="https://theinventory.com/its-never-been-cheaper-to-build-a-projector-focused-hom-1831875960#_ga=2.115301191.111474295.1548374619-239710550.1544887007">perfect option</a> for budget-conscious consumers who want to dip their toes in a different kind of home theater. It regularly sells for around $270, and that price was already a great bargain—but this deal pushes it even lower.</p> <p>Additionally, Amazon’s also lowering the price on the <a href="https://www.amazon.com/Projector-Anker-Portable-High-Contrast-Playtime/dp/B07797WTQ7?tag=kinjadeals-20&amp;ascsubtag=dce5abea63ed3bfc1a034df483a7f3a3b51e59a9">Nebula Capsule</a>, a <a href="https://gear.lifehacker.com/anker-packed-a-shockingly-decent-portable-cinema-into-a-1822204809">surprisingly good</a> portable projector shrunk down to the size of a soda can. For a limited time, the Capsule is marked down to $224 on Amazon, down from the usual $300.</p> <h3>#6 backcountry</h3> <p>The most coveted brands are also often the most expensive, but now at <a href="http://backcountry.pxf.io/c/379647/358742/5311?subId1=kinjadeals-&amp;u=https%3A%2F%2Fwww.backcountry.com%2Frc%2Ftake-an-additional-20-off-big-brands%3Fp%3DdiscountPercentUSbcs%253A%255B10%2BTO%2B%2A%255D">Backcountry</a>, you can take an <a href="http://backcountry.pxf.io/c/379647/358742/5311?subId1=kinjadeals-&amp;u=https%3A%2F%2Fwww.backcountry.com%2Frc%2Ftake-an-additional-20-off-big-brands%3Fp%3DdiscountPercentUSbcs%253A%255B10%2BTO%2B%2A%255D">additional 20% off select apparel and gear from the big brands you know and love</a>, including Patagonia, The North Face, Marmot, Sorel, and more. In case you’ve been off on some isolated peak somewhere, Backcountry’s also running its <a href="https://kinjadeals.theinventory.com/get-all-the-winter-gear-youll-ever-need-at-backcountrys-1832259368?ks=searchpage">Semi-Annual Sale</a>, so that’s a really good deal on top of a deal. The added discount will be automatically applied to eligible items in your cart, so go ahead and check out so you can get outside and use your new stuff.</p> <h3>#7 game of thrones</h3> <p>Bend the knee and pledge your sword to the Lord of Deals to gain access to this <a href="https://www.amazon.com/Game-Thrones-Complete-Seasons-Digital/dp/B07617BK8N/?kinja_price=75&amp;tag=kinjadeals-20&amp;ascsubtag=5fdd0376371671ac02f24ffaa42091ddf6e460d8"><em>Game of Thrones</em> seasons 1-7 box set for $90</a>, complete with Blu-rays and digital copies of every episode released so far. That’s $140 less than usual, so you won’t have to take out a loan from the Iron Bank of Braavos.<br></p> <h3>#8 reebok</h3> <p>If you work out regularly, or uh, at all, you deserve a medal. Or just treat yourself to some new sneakers and/or activewear from <a href="https://www.reebok.com/us/men-sale">Reebok</a>. Right now, the sports-minded retailer is <a href="https://www.reebok.com/us">30% off everything on their site</a>, plus <a href="https://www.reebok.com/us/men-sale">an extra 50% off men’s</a> <a href="https://www.reebok.com/us/women-sale">and women’s sale styles</a> with <strong>promo code FAM.</strong> Chances are, you’ll make good use of these purchased for many workouts to come.</p> <h3>#9 xbox one x nba 2k19 bundle</h3> <p>In terms of sheer power and graphical capability, nothing can top the <a href="https://rover.ebay.com/rover/1/711-53200-19255-0/1?ff3=4&amp;toolid=11800&amp;pub=5575307843&amp;campid=5338102708&amp;mpre=https%3A%2F%2Fwww.ebay.com%2Fitm%2FXbox-One-X-1TB-NBA-2K19-Bundle-Digital-download-of-NBA-2K19-included-Black%2F123365691144">Xbox One X</a>. So if you want to experience modern games like <em>Red Dead Redemption 2</em> and <em>Assassin’s Creed Odyssey</em> in their full 4K HDR glory, you can save $150 today on a bundle that includes <a href="https://rover.ebay.com/rover/1/711-53200-19255-0/1?ff3=4&amp;toolid=11800&amp;pub=5575307843&amp;campid=5338102708&amp;mpre=https%3A%2F%2Fwww.ebay.com%2Fitm%2FXbox-One-X-1TB-NBA-2K19-Bundle-Digital-download-of-NBA-2K19-included-Black%2F123365691144">a copy of <em>NBA2K19</em></a>, the best deal we’ve ever seen.<br></p> <p>For some comparison, this same bundle on Amazon costs $390 right now, or $40 more.</p> <h3>#10 red wing</h3> <p>When you hear the words “leather boots,” you probably picture one of <a href="http://www.pntrac.com/t/8-10134-163529-120793?url=https%3A%2F%2Fwww.nordstromrack.com%2Fevents%2F281584&amp;sid=kinjadeals-">Red Wing</a>’s classic pairs; they are truly the quintessential lace-up leather boot for dudes. And today, they’re <a href="http://www.pntrac.com/t/8-10134-163529-120793?url=https%3A%2F%2Fwww.nordstromrack.com%2Fevents%2F281584&amp;sid=kinjadeals-">marked down by up to 50% at Nordstrom Rack</a>. Choose from range of iconic styles (though I personal recommend the <a href="http://www.pntra.com/t/8-10134-163529-120793?url=https%3A%2F%2Fwww.nordstromrack.com%2Fevents%2F281584%2Fproducts%2F2693290%2Fred-wing-6-inch-moc-toe-leather-boot%3Fcolor%3DBROWN%2520BOOMER&amp;sid=kinjadeals-">6-Inch Moc Toe Leather Boot</a>), including a few <a href="http://www.gopjn.com/t/8-10134-163529-120793?url=https%3A%2F%2Fwww.nordstromrack.com%2Fevents%2F281584%2Fproducts%2F2657638%2Fred-wing-leather-lace-up-derby-factory-second%3Fcolor%3DBLACK%2520KLONDIKE&amp;sid=kinjadeals-">non-boot options</a>. Snag your favorite from Red Wing before it flies away; these shoes will definitely sell out quickly. </p> "
"full_text":"We see a lot of deals around the web over on Kinja Deals, but these were our ten favorites today. Head over to our main post for more deals, and follow us on Twitter and Facebook to never miss a chance to save. You can also join our Kinja Deals Community Facebook group to connect with your fellow deal hunters. #1 Sony 4k tv Amazon has a Sony 60-inch smart 4K TV for under $800 right now, as part of its Gold Box. This LED unit offers lots of the features you’d want in a TV, such as HDR10, Alexa compatibility and Chromecast built-in, and a 120hz refresh rate. Better still, this current price about $350 off its average price. #2 refurb roomba Woot’s discounting the powerful Roomba 860 down to just $275 for a refurb. While it is still quite a bit more expensive than, say, the Eufy RoboVac 11, it boasts up to five times the sucking power of the comparable Roomba 650, so if you have kids or pets that tend to track in a lot of dirt, it might be worth the premium. You can schedule a cleaning 7x during the week and it’ll navigate around furniture and avoid stairs. This Roomba will automatically dock and recharge, too, which is super convenient. #3 nintendo switch bundle Walmart’s letting you build your own Nintendo Switch bundle for just $330. Choose a console, either the neon blue/red or the gray Joy-Cons and a Mario game (Mario Kart 8 Deluxe, New Super Mario Bros U Deluxe, Super Mario Odyssey, Mario Tennis Aces or Super Mario Party), and Walmart will throw in some sweet pins and a less-sweet, designated guest controller. If you’ve been putting off buying a Switch... well, dude. I mean, come on. #4 clarks At the intersection of “cute” and “comfortable,” you will find Clarks. And right now, the footwear brand is taking up to 60% off clearance items for men, women, and kids, plus an extra 20% off your clearance purchase with promo code OUTLET. Treat your feet to new boots, loafers, slip-ons, and more from this shoo-in of a sale before it’s over. #5 anker projectors If you want to build a budget, projector-based home theater, the Prizm II is a good one to consider, and right now you can get it for just $189 thanks to Amazon’s Gold Box. It’s the perfect option for budget-conscious consumers who want to dip their toes in a different kind of home theater. It regularly sells for around $270, and that price was already a great bargain—but this deal pushes it even lower. Additionally, Amazon’s also lowering the price on the Nebula Capsule, a surprisingly good portable projector shrunk down to the size of a soda can. For a limited time, the Capsule is marked down to $224 on Amazon, down from the usual $300. #6 backcountry The most coveted brands are also often the most expensive, but now at Backcountry, you can take an additional 20% off select apparel and gear from the big brands you know and love, including Patagonia, The North Face, Marmot, Sorel, and more. In case you’ve been off on some isolated peak somewhere, Backcountry’s also running its Semi-Annual Sale, so that’s a really good deal on top of a deal. The added discount will be automatically applied to eligible items in your cart, so go ahead and check out so you can get outside and use your new stuff. #7 game of thrones Bend the knee and pledge your sword to the Lord of Deals to gain access to this Game of Thrones seasons 1-7 box set for $90, complete with Blu-rays and digital copies of every episode released so far. That’s $140 less than usual, so you won’t have to take out a loan from the Iron Bank of Braavos. #8 reebok If you work out regularly, or uh, at all, you deserve a medal. Or just treat yourself to some new sneakers and/or activewear from Reebok. Right now, the sports-minded retailer is 30% off everything on their site, plus an extra 50% off men’s and women’s sale styles with promo code FAM. Chances are, you’ll make good use of these purchased for many workouts to come. #9 xbox one x nba 2k19 bundle In terms of sheer power and graphical capability, nothing can top the Xbox One X. So if you want to experience modern games like Red Dead Redemption 2 and Assassin’s Creed Odyssey in their full 4K HDR glory, you can save $150 today on a bundle that includes a copy of NBA2K19, the best deal we’ve ever seen. For some comparison, this same bundle on Amazon costs $390 right now, or $40 more. #10 red wing When you hear the words “leather boots,” you probably picture one of Red Wing’s classic pairs; they are truly the quintessential lace-up leather boot for dudes. And today, they’re marked down by up to 50% at Nordstrom Rack. Choose from range of iconic styles (though I personal recommend the 6-Inch Moc Toe Leather Boot), including a few non-boot options. Snag your favorite from Red Wing before it flies away; these shoes will definitely sell out quickly."
"title":"The 10 Best Deals of March 12, 2019"
"url":"https://kinjadeals.theinventory.com/the-10-best-deals-of-march-12-2019-1833243213?"
"image":"https://i.kinja-img.com/gawker-media/image/upload/s--fox-7aL---/c_fill,fl_progressive,g_center,h_900,q_80,w_1600/jpjn3jyrcy3gg4tw27u5.jpg"
"keywords":"march"
"source":"gizmodo.com"
"words":"best deals march see lot deals around web kinja deals ten favorites today. head main post deals follow twitter facebook never miss chance save can als ..."
"images":[1 item
0:"https://i.kinja-img.com/gawker-media/image/upload/s--fox-7aL---/c_fill,fl_progressive,g_center,h_900,q_80,w_1600/jpjn3jyrcy3gg4tw27u5.jpg"
]
"id":"3190994056050925498"
"title_words":"best deals march"
}