Парсер JS::TextFromSE 2.0

Попробуйте флаг g добавить

Код:

  this.conf[this.conf.search_engine.replace(/::/g, '_') + '_preset'],

 

Да работает спасибо )

 

Как можно побороть неработающий как нужно метод this.proxy.set('http://10.10.2.253:8080', true). Пытаюсь заставить HTML::TextExtractor ходить через быстрый прокси или вообще его не использовать, но все равно устанавливается прокси тот который в списке для парсинга Google.

Код:

    *parseText(set, results) {
        this.logger.put("Scraping text from " + set.query);
        this.proxy.set('http://10.10.1.253:8080', true);
        this.logger.put("Proxy: " + this.proxy.get());
        let response = yield this.parser.request('HTML::TextExtractor', this.conf.HTML_TextExtractor_preset, set.query);
        results.key = set.first;
        results.link = set.query;
        this.logger.put("Proxy result: " + this.proxy.get());
        if(response.info.success) {
            results.text =  response.texts.join("\n");
            results.title = response.data.match(/<title>\s*(.+?)\s*<\/title>/)[1];
            this.logger.put(set.query + " - " + response.texts.length + " blocks, " + results.text.length + " chars filename:" + results.filename);
            results.success = 1;
        }
        else {
            this.logger.put(set.query + " - error scraping text");
            results.success = 0;
        }
 
        return results;
    }

По логу видно что прокси меняется на другой, и по результату парсинга IP адрес сайт определяет не тот что я подставляю, локальный прокси рабочий отдельно проверяю его:

Код:

08/12 13:37:37 Parser JS::TextFromSE::0 parse query https://myexternalip.com/
08/12 13:37:37 Use proxy socks://88.***.***.172:35010
08/12 13:37:37 Scraping text from https://myexternalip.com/
08/12 13:37:37 Use proxy http://10.10.1.253:8080
08/12 13:37:37 Proxy: http://10.10.1.253:8080
08/12 13:37:37 Use proxy socks://88.***.***.188:24740
08/12 13:37:44 GET(1): https://myexternalip.com/ - 200 OK (10.21 KB)
08/12 13:37:44 Decode from utf-8(meta charset)
08/12 13:37:44 Parse response: 1
08/12 13:37:44 Proxy result: socks://88.***.***.188:24740
08/12 13:37:44 https://myexternalip.com/ - 23 blocks, 8423 chars filename:undefined
08/12 13:37:44Thread complete work queries_from_text.txt/files/site_myexternalip.com.txt

 

Здравствуйте!
Ошибку удалось подтвердить на своих проектах. Согласно этому, создана задача здесь. Когда ошибка будет исправлена или устранена других способом, в теме будет размещено сообщение.

 

Еще есть вопрос или проблема которая возникла у меня после последних обновлений. Сменой установки прокси я пытался устранить зависающий парсер, я думал что из-за проксей второй парсер HTML::TextExtractor из-за сетевых потерь или неустойчивой работы прокси начинает подвисать.

Но сегодня я разъединил два парсера, как ни странно SE::Google::Modern 20000 ключей прошел на одном дыхании. Дальше ссылки зарядил HTML::TextExtractor и понимаю что он по какой-то причине перестал парсить, вернее он парсит и стартует резво, но после 5-20 минут скорость падает и он подвисает и стопорится. С прокси, без прокси, сбрасываю в дефолтные настройки - убираю все фильтры и обработку результата - результат один 5-20 минут и все виснет. 3 дня копаюсь. Иногда вообще не стартует лог такой:

Код:

Dec 10 23:53:28.02008 [master] starting task #753 threads: 100
Dec 10 23:53:37.19996 [master] GC takes 3.13826298713684
Dec 10 23:57:36.55417 [master] GC takes 2.49235200881958

До этого этот же JS::TextFromSE работал без проблем.
Еще в логе много строчек такого плана:

Код:

Dec 10 23:51:28.82071 [master] long parsing(0.528845071792603): HTML::TextExtractor::0, query: https://sites.google.com

В чем может быть причина? Может из-за обновление JavaScript движок V8 версии 6.3. Пробую запускать как на Linux Ubuntu 17.04 и на Win2012, сервера отдельные для парсинга, левого софта нет. A-parser пробовал stable и beta

Опять попробовал зависание прошло после таких строчек

Код:

Dec 11 01:40:46.66869 [master] long parsing(0.120748996734619): HTML::TextExtractor::0, query: http://********.info/skin-care/**********.htm
Dec 11 01:41:02.06101 [master] GC takes 9.216637134552
Dec 11 01:45:58.61448 [master] GC takes 5.7700080871582

 

Здравствуйте. Если у вас установлен TeamViewer сбросьте в личку ID и пароль.
Skype: Denis A-Parser Support
Telegram: @aparser2

 

Добрый день! Как проблема была решена? Имею аналогичную проблему при парсинге текста (как выше было описано уважаемым Newsoros)
В логах аналогичная дрянь:
Dec 12 16:17:05.76429 [master] GC takes 2.42330718040466
Dec 12 16:20:05.53238 [master] GC takes 2.19127750396729
Dec 12 16:23:05.63027 [master] GC takes 2.28879189491272
Dec 12 16:26:05.57964 [master] GC takes 2.23778581619263
Dec 12 16:29:05.60002 [master] GC takes 2.25728678703308
Dec 12 16:32:05.67191 [master] GC takes 2.32879567146301
Dec 12 16:35:05.61578 [master] GC takes 2.27228903770447
Dec 12 16:38:05.46763 [master] GC takes 2.12377047538757
Dec 12 16:41:05.76605 [master] GC takes 2.42030787467957
Dec 12 16:44:05.65091 [master] GC takes 2.29729223251343

 

Здравствуйте.
Будет исправлено в ближайших версиях.

 

Хотелось бы узнать, когда будут исправления, до Нового года успеете? А то вся работа стоит без парсинга текста.
Я так понимаю проблема с HTML::TextExtractor?
Может быть как то без потери настроек можно откатится до предыдущей рабочей версии парсера? Как это сделать правильно, если можно?

 

Здравствуйте
Скиньте пожалуйста код пресета и запросы.

 

Спойлер: Пресет

eyJwcmVzZXQiOiJDb250ZW50X2Rvd2xhZGVyIiwidmFsdWUiOnsicHJlc2V0Ijoi
Q29udGVudF9kb3dsYWRlciIsInBhcnNlcnMiOltbIkhUTUw6OlRleHRFeHRyYWN0
b3IiLCJkZWZhdWx0Iix7InR5cGUiOiJmaWx0ZXIiLCJyZXN1bHQiOlsidGV4dHMi
LCJ0ZXh0Il0sImZpbHRlclR5cGUiOiJyZW1hdGNoIiwidmFsdWUiOiJbICxcXHdc
XGRdezE0MCx9WyE/Ll0iLCJvcHRpb24iOiIifSx7InR5cGUiOiJvdmVycmlkZSIs
ImlkIjoibWluYmxvY2tsZW5ndGgiLCJ2YWx1ZSI6IjMwMCJ9LHsidHlwZSI6ImN1
c3RvbVJlc3VsdCIsInJlc3VsdCI6ImRhdGEiLCJyZWdleCI6Ijx0aXRsZT4oW148
Pl0qKTwvdGl0bGU+IiwicmVnZXhUeXBlIjoiaXMiLCJyZXN1bHRUeXBlIjoiZmxh
dCIsImFycmF5TmFtZSI6IiIsInJlc3VsdHMiOlsidGl0bGUiXX1dXSwicmVzdWx0
c0Zvcm1hdCI6IiRwMS5wcmVzZXQiLCJyZXN1bHRzU2F2ZVRvIjoiZmlsZSIsInJl
c3VsdHNGaWxlTmFtZSI6InRleHQvJHtwMS50aXRsZX0udHh0IiwiYWRkaXRpb25h
bEZvcm1hdHMiOltdLCJyZXN1bHRzVW5pcXVlIjoibm8iLCJxdWVyaWVzRnJvbSI6
ImZpbGUiLCJxdWVyeUZvcm1hdCI6WyIkcXVlcnkiXSwidW5pcXVlUXVlcmllcyI6
ZmFsc2UsInNhdmVGYWlsZWRRdWVyaWVzIjpmYWxzZSwiaXRlcmF0b3JPcHRpb25z
Ijp7Im9uQWxsTGV2ZWxzIjpmYWxzZSwicXVlcnlCdWlsZGVyc0FmdGVySXRlcmF0
b3IiOmZhbHNlLCJxdWVyeUJ1aWxkZXJzT25BbGxMZXZlbHMiOmZhbHNlfSwicmVz
dWx0c09wdGlvbnMiOnsib3ZlcndyaXRlIjpmYWxzZX0sImRvTG9nIjoibm8iLCJr
ZWVwVW5pcXVlIjoiTm8iLCJtb3JlT3B0aW9ucyI6ZmFsc2UsInJlc3VsdHNQcmVw
ZW5kIjoiIiwicmVzdWx0c0FwcGVuZCI6IiIsInF1ZXJ5QnVpbGRlcnMiOltdLCJy
ZXN1bHRzQnVpbGRlcnMiOlt7InNvdXJjZSI6WzAsWyJ0ZXh0cyIsInRleHQiXV0s
InR5cGUiOiJyZWdleFJlcGxhY2UiLCJhcnJheSI6InRleHRzIiwicmVnZXgiOiIo
P20pXi57MCwxNDB9KFxcbnxcXHJ8JCkrIiwicmVnZXhUeXBlIjoiZyIsInJlcGxh
Y2UiOiIiLCJ0byI6InRleHQifV0sImNvbmZpZ092ZXJyaWRlcyI6W10sInJ1blRh
c2tPbkNvbXBsZXRlIjpudWxsLCJ1c2VSZXN1bHRzRmlsZUFzUXVlcmllc0ZpbGUi
OmZhbHNlLCJydW5UYXNrT25Db21wbGV0ZUNvbmZpZyI6ImRlZmF1bHQiLCJ0b29s
c0pTIjoiIiwicHJpbyI6NSwicXVlcmllc0ZpbGUiOlsicmVzdWx0cy9vbHZva2V5
X3VybDIudHh0Il0sImNhdGVnb3J5IjpbXX19

Спойлер: Запросы

https://www.verywell.com/stress-management-4014642
https://labtestsonline.org/understanding/conditions/pancreatitis
http://www.emedexpert.com/tips/music.shtml
https://www.wikihow.com/Get-Rid-of-a-Headache
https://healthfully.com/injury/
https://en.wikipedia.org/wiki/Headache
https://healthyliving.azcentral.com/nutrition/
http://www.mayoclinic.org/tests-procedures/meditation/in-depth/meditation/art-20045858
http://www.usdoctor.com/sym7.htm
https://en.wikipedia.org/wiki/Migraine_headache
http://everydayroots.com/headache-remedies
https://draxe.com/peppermint-oil-uses-benefits/
https://draxe.com/stress-relievers/
http://americanpregnancy.org/pregnancy-health/headaches-and-pregnancy/
http://howtofastdietloseweighti.com/21-detox-diet-plan-relieve-stress=cr5268/
https://www.thefreedictionary.com/relieve
http://www.healthyandnaturalworld.com/essential-oils-to-relieve-pain/
https://www.babycenter.com/0_headaches-during-pregnancy_2035.bc
http://www.gentle-stress-relief.com/nettle-infusion.html
https://www.medicalnewstoday.com/articles/73936.php
https://www.health.harvard.edu/blog...n-may-ease-anxiety-mental-stress-201401086967
https://www.dietspotlight.com/relora-review/
https://www.wikihow.com/Relieve-a-Tension-Headache
https://www.wikihow.com/Remove-All-Tension-from-Your-Body
https://www.verywell.com/natural-remedies-for-cluster-headache-relief-89239
http://www.umm.edu/health/medical/altmed/herb/lavender
http://www.medhelp.org/posts/Migraines--Headaches/Headaches-from-laying-down/show/391321
http://www.medhelp.org/posts/Neurology/Light-Headedness--Feeling-Weak---Headaches/show/339463
http://naturalpregnancyguidei.com/w...-weeks-pregnant-and-getting-headaches=ch7719/
http://alcoholrehab.com/drug-addiction/stress-and-substance-abuse/
http://www.kamaainaacupuncture.com/
https://en.wikipedia.org/wiki/Sleep_deprivation
https://www.medicinenet.com/chemotherapy/article.htm
https://en.wikipedia.org/wiki/Hiatus_hernia
https://www.medicinenet.com/tension_headache/article.htm
https://www.healthline.com/health/tension-headache
https://www.aha-now.com/stress-headache-relief-techniques/
https://www.calmclinic.com/anxiety/symptoms/headaches
http://www.umm.edu/health/medical/altmed/condition/tension-headache
https://draxe.com/natural-headache-remedies-relief/
https://www.popsugar.com/fitness/Yoga-Headaches-1964513
https://medlineplus.gov/stress.html
https://www.webmd.com/migraines-headaches/features/migraines-and-sex
https://www.pinterest.com/explore/headache-pressure-points/
http://www.massgeneral.org/conditions/condition.aspx?id=313
https://www.macafem.com/blog/macafem-best-tips-relieving-prolonged-headaches-menopause/
https://www.amtamassage.org/approve...e-Can-Be-Effective-for-Tension-Headaches.html
https://draxe.com/tension-headache/
https://paindoctor.com/conditions/headaches/
https://www.naturalblaze.com/2016/09/relieve-migraine-headache-triggers.html
http://www.health.com/migraines-headaches
https://www.tylenol.com/symptoms
http://www.healthcommunities.com/headache/about-headaches.shtml
http://www.onegreenplanet.org/natural-health/use-essential-oils-to-relieve-headaches/
https://dhch.kramesonline.com/HealthSheets/3,S,83510
https://www.hudsonvalleyscoliosis.com/scoliosis-and-headaches/
https://www.healthtap.com/topics/tragus-piercing-prevent-headaches
https://ssl.adam.com/content.aspx?p...e=quicksheets2010.adam.com&login=PFIZ6816
http://www.dailymotion.com/video/x68mop2
https://hvella.com/tag/how-to-relieve-stress-headaches
https://www.seton.net/brain-and-spine-care/neurology/headaches-migraines/
http://www.umm.edu/health/medical/reports/articles/headaches-cluster
http://medical-dictionary.thefreedictionary.com/stress
https://health.howstuffworks.com/we...home-remedies/home-remedies-for-headaches.htm
http://www.prediabetes.headaches.di...diabetics-type-2/prediabetes-headaches=r13883
https://www.verywell.com/stress-relief-activities-you-should-try-3144614
http://www.foxnews.com/story/2009/07/07/11-home-remedies-for-migraine-headaches.html
https://www.thephysiomovement.com.au/services/headache-spine-clinic/
https://www.amazon.ca/Headache-Remedies-Headaches-Naturally-Migraine-ebook/dp/B00E5O0OJY
http://www.getsmp3.com/song-download/to-relieve-headaches.html
https://www.migrainesurvival.com/stabbing-headache-or-icepick-headache
http://actionhealth.com.au/headaches-migraines-neck-pain-relief/
https://www.livestrong.com/article/107286-medications-relieve-stress-anxiety/
https://www.wantitall.co.za/healthp...eck-and-back-pain-from-stress-in-__b008vn1mci
https://www.massagemag.com/figure-s...saver-to-relieve-headaches-be-proactive-2134/
http://www.painneck.com/herniated-disc-neck/
https://www.yogaoutlet.com/guides/how-to-relieve-stress-with-yoga/
http://www.neilmed.com/neilmedblog/2011/08/sinus-headaches-and-migraines/
https://www.medgift.com/themedgiftv...r-points-to-relieve-muscle-tension-headaches/
http://www.healthy-holistic-living.com/herbal-stress-remedies.html
http://www.diabetes.causes.headaches.diabeteshx.com/diabetes-causes-headaches=k2941/
http://selfcarer.com/foods-that-relieve-stress/
https://www.proteethguard.com/relationship-between-stress-insomnia-and-sleep-bruxism/
http://www.advancedphysicalmedicine...hes-migraines-vertigo-after-car-accident.html
http://kidshealth.org/en/parents/headache.html
https://www.livestrong.com/article/551212-cardio-exercises-sinus-pressure/
http://www.healthy-holistic-living.com/lavender-lemonade-recipe-headaches-anxiety.html
http://allfornursing.blogspot.com/2011/04/fyi-10-ways-to-relieve-stress.html
http://www.deancare.com/wellness/stress-management/stress-and-caffeine/
http://www.cnn.com/HEALTH/livingwell/headaches.migraines/
http://www.dailymail.co.uk/health/article-1275419/Best-cure-migraine-headaches-cup-coffee-two.html
https://www.aliexpress.com/popular/stress-headaches.html
https://www.reddit.com/r/migraine/comments/3ea5gb/piercing_to_relieve_migraines/
https://ufhealth.org/tension-headache
https://www.cdc.gov/violenceprevention/pub/coping_with_stress_tips.html
http://www.medhelp.org/posts/Migraines--Headaches/6-month-headache/show/1278354
http://healthquestions.medhelp.org/flonase-and-headaches
https://www.microsoft.com/en-us/sto...m-headaches-music-for-stress-rel/8d6kgwx5mghn
http://headache.emedtv.com/headaches/headaches.html
http://www.smart-publications.com/a...-honokiol-and-magnolol-from-magnolia-extract/
http://www.drcchiropractic.com/
https://www.ebay.co.uk/itm/Still-Po...lps-Reduce-Stress-And-Headaches-/401344010869
http://www.abta.org/brain-tumor-information/symptoms/headaches.html
http://www.onlymyhealth.com/health-...7-beverages-to-relieve-stress-1420800382.html
http://www.headaches.org/2007/10/25/arthritis/
http://www.powershow.com/view/d48ff-Yjk1M/How_To_Relieve_Stress_powerpoint_ppt_presentation
https://answers.yahoo.com/question/index?qid=20070705051816AA8sH6g
http://eheatburn.com/Aloe-Vera-Liquid-For-Acid-Reflux/Acid-Reflux-Headaches=p03537b.html/
http://ajournalistreveals.com/how-does-participating-in-sports-relieve-stress/
http://www.naturalux.com/NaturaLux_Lighting_Filters_Glare.htm
https://ehealthforum.com/health/stomach-pain-headaches-weight-loss-t207430.html
http://www.does.diabetes.cause.headaches.diabeteshx.com/does.diabetes.cause.headaches=h10029
http://diabetescx.com/diabetic-care-log/diabetic.headaches=l8979
https://www.reddit.com/r/TheGirlSurvivalGuide/comments/2rrvxq/ponytail_headaches/
https://www.huffingtonpost.com/2013/05/19/yoga-for-anxiety-10-poses_n_3281986.html
https://bodyecology.com/articles/can-green-tea-reduce-anxiety-stress.php
https://customcandleco.com/product/lemongrass-essential-oil/
http://heatburnio.com/Stress.And.Acid.Reflux.Cough/Does.Acid.Reflux.Cause.Headaches=p03530b.aspx/
http://www.shopping.com/Relieve-Stress-with/products
http://www.crystalgraphics.com/powerpictures/images.photos.asp?ss=relieve
http://www.does.diabetes.cause.headaches.diabeteshx.com/does.diabetes.cause.headaches=y10029/
https://www.buzzle.com/articles/headaches/
http://diabetescx.com/headaches-diabetes=d10931/
http://www.viva.co.nz/video/beauty-wellbeing/watch-yoga-to-relieve-shoulder-tension/
http://www.carex.com/products/2085/Hot-+-Cold-At-Home/
http://mobsea.co/headache/
http://www.natural.getheatburn.com/Acid.Reflux.And.Headaches.Is.There.A.Link=p05795a.html
http://dailyhardherb.com/2017/11/21/kratom-helps-to-cure-stress/
https://www.radiantrinse.com/listing/577142223/lavender-essential-oil
http://acupuncturestore.net/products/acupressure-mat-for-safe-and-effective-therapy/
http://jadeacupuncturebrisbane.com.au/lets-talk-stress/
http://34.232.212.166/category/conditions/migraines-headaches/
http://www.mp3x.co.za/mp3/Extrкme-Stress-Dйcompression.html
https://starkmans.com/sinus-mask-green.html
http://www.parathyroid.com/parathyroid-symptoms.htm
http://www.gotcore.net/index.php/news/tame-stress-and-improve-health
https://www.pharmacyonline.com.au/pharmaceuticals/Migraine-Tablets
https://www.marchofdimes.org/pregnancy/common-discomforts-of-pregnancy.aspx
https://www.wildflowersaromatherapy.com/wb-products.php#!/Eye-Pillows/p/49369634
https://www.firstclassmedicinal.com/shop/concentrates/blush-sugar-wax-1g-kind-selections/
https://www.farrarchiro.com/category/chiropractors-and-your-health/
https://kushfly.com/product/northern-lights/
https://www.pharmacyonline.com.au/pharmaceuticals/Cold-And-Flu-Day
https://personalinjurydoctorgroup.com/tag/posture/amp/@dralexjimenez/@dralexjimenez/
http://www.ntillinois.com/wp-content/uploads/Concentrates-Downloadable-Menu-18.pdf
http://yourgreshamchiro.com/services-offered.html
https://drjlambert.com/spinal-decompression.html?platform=hootsuite
https://personalinjurydoctorgroup.com/amp/page/8/
https://kushfly.com/product/mango/?add_to_wishlist=266218
https://drjlambert.com/ligament-laxity-analysis-suffolk-county.html?platform=hootsuite
http://www.fargospineandrehab.com/services/back-pain.html
https://www.wildflowersaromatherapy.com/wb-products.php#!/Sleep-mask/p/49369682
http://mulberrymoonafrica.co.za/product/tasly-cerebral-granules/
http://topsteamers.com/microwave-hot-pack/
https://sparkschiropractic.com/about-us/our-team.html
http://shoppertom.com/products/Hermell_Softeze_Comfy_Pillow/all/all/searchResults
https://brandnewwitch.tumblr.com/
https://www.webmd.com/migraines-headaches/features/prevent-stress-headaches
https://www.webmd.com/balance/stress-management/features/massage-therapy-stress-relief-much-more
http://www.mayoclinic.org/diseases-conditions/tension-headache/in-depth/headaches/art-20046707
http://www.mayoclinic.org/diseases-conditions/tension-headache/in-depth/headaches/art-20047631
http://www.esbae.com/ask/how_to_relieve_stress_headaches
https://en.wikipedia.org/wiki/Tension_headache
http://www.la-retraite-info.com/har...lieving-and-preventing-migraine-and-other.pdf
http://m.onlymyhealth.com/relieve-headache-and-stress-with-acupressure-in-thirty-seconds-1410953803
http://www.heraldargus.com/news/rel...cle_85b2ffaa-faee-5b04-9f89-f0c1537b8461.html
https://www.webmd.boots.com/migraines-headaches/ss/slideshow-headache-relief
https://www.verywell.com/
https://talkchick.com/relieve-headache-acupressure/
https://www.naturalblaze.com/2013/05/6-ways-to-relieve-headaches-with.html
http://ezinearticles.com/?How-to-Relieve-Stress-Headaches&id=3567535
https://www.helpguide.org/harvard/stress-relief-guide.htm
http://www.healthy-holistic-living.com/101-ways-never-knew-relieve-pain.html
https://www.healthcentral.com/encyclopedia/h/headache
https://www.m.webmd.boots.com/a-to-z-guides/migraine-headache-triggers-caffeine
https://www.ucsfhealth.org/conditions/tension_headaches/treatment.html
https://www.cdc.gov/niosh/topics/stress/default.html
https://www.livestrong.com/article/22383-relieve-neck-shoulder-tension/
http://www.stack.com/a/stress-headaches
http://www.thephysiocompany.com/injury-or-condition/tension-headaches/
https://www.acufinder.com/Acupuncture+Information/Detail/Acupuncture+Treats+Headaches+and+Migraines
https://www.pinterest.com/explore/pressure-points-for-headaches/
http://www.streetdirectory.com/travel_guide/editorials/other/relieve+headaches/
https://www.pinterest.com/pin/111112315780386255/
http://onlinepharmacy.50r.in/how-to...ally-after-50-how-to-prevent-stress-headaches
http://www.healthy.net/Health/Essay/Magnesium_The_Stress_Reliever/74
http://www.healthcommunities.com/he...dicine/naturopathic-headache-treatments.shtml
http://www.musclemagfitness.com/nat...rticles/tips-to-cure-headaches-naturally.html
http://www.litalee.com/shopexd.asp?id=200
https://www.drfuhrman.com/learn/health-concerns/72/headaches-and-migraines
http://www.relieve-migraine-headache.com/magnesium-migraines.html
https://www.prevention.com/fitness/fitness-tips/reduce-stress-walking-exercise
http://www.dynamicchiropractic.com/mpacms/dc/press_release.php?id=184
http://www.medindia.net/news/Use-Of...ches-Can-Lead-To-Chronic-Insomnia-47575-1.htm
https://www.myvmc.com/health/headaches-and-migraines/
http://neemking.org/shop-by-symptom/headache/
https://health.clevelandclinic.org/2015/06/your-jaw-may-be-to-blame-for-your-migraine-headaches/
https://www.healing-crystals-for-you.com/crystal-headaches.html
https://www.choosehelp.com/topics/d...-opioid-withdrawal-headaches-and-muscle-pains
https://www.excedrin.com/
https://www.askdrsears.com/topics/p...t-partum/easy-ways-relieve-post-partum-stress
http://www.dreamsoftz.com/2017/12/07/tell-bye-bye-to-migraine-headaches-natural-medicines/
http://www.acupressure.com/blog/index.php/category/headaches-mental-health-self-care/

В логах вот такие последние строчки:
News - Crain's Chicago Business

.txt" at build/core.to_build.pl line 14969.
Dec 15 18:42:44.65645 [master] long parsing(0.134397029876709): HTML::TextExtractor::0, query: https://www.allbud.com/dispensaries/washington/kirkland/higher-leaf/menu
Dec 15 18:42:44.83704 [master] long parsing(0.162850856781006): HTML::TextExtractor::0, query: http://mssinglemama.com/2008/05/02/should-i-leave-my-husband/
Dec 15 18:43:02.25386 [master] long parsing(0.212020874023438): HTML::TextExtractor::0, query: http://www.science.gov/topicpages/u/unequal+mitotic+sister.html
Dec 15 18:43:52.93910 [master] GC takes 1.5686993598938

 

Уточните какая у вас ОС ?

 

Парсер работает под управление Windows 10 64-битная

 

Версия парсера тоже 64 битная ?

 

А как это узнать, обновлял то прям из парсера, версия стоит на данный момент 1,2,37

 

В логе можно посмотреть.

Код:

Dec 18 18:38:52.64517 [master] A-Parser v1.2.38-windows-x64 started, tasks: 1 / 396, memory total: 14503 MB, available: 6078 MB
Dec 18 18:38:52.64908 [master] starting task #4157 threads: 3

x64 значит 64. x86 значит 32

 

Выходит значит так;
[master] A-Parser v1.2.37-windows-x86 started, tasks: 3 / 4451, memory total: 0 MB, available: 0 MB

 

Напишите, пожалуйста, мне в личку, чтобы ускорить процесс решения проблемы.
telegram : @aparser2
Skype : Денис A-Parser Support

 

Подскажите, как сделать чтобы при парсинге сохранялось только 20 предложений текста на один запрос?

 

Здравствуйте. Создайте пресет для SE::Google или SE::Yandex (в зависимости от выбранного вам варианта), в котором укажите Кол-во страниц 1 и результатов на страницу 20.