Research talk:Automated classification of article importance/Work log/2017-03-20

Monday, March 20, 2017

Today I will work on the WPMED classifier, looking at the articles the new & improved classifier does not predict correctly. Once that is ready I want to sketch out a post to WPMED so we can start chatting about what importance means. Lastly, I'll go through our list of sources of signal and start making some decisions about where to move next.

WPMED prediction errors

Like we did last week, I'll generate lists of the perhaps most interesting articles.

Top-importance predicted Low-importance	Top-importance predicted Mid-importance	High-importance predicted Low-importance
No Top-importance articles were predicted to be Low-importance	Major trauma Near-sightedness Refractive error Tooth decay	1852–60 cholera pandemic 1881–96 cholera pandemic Adherence (medicine) Anna Suk-Fong Lok Basic symptoms of schizophrenia Biobank ethics Breast cancer management Childhood leukemia Children's hospice Christine Williams (nutritionist) Chukwuedu Nwokolo Cocaine (data page) Complications of hypertension Destination therapy Dimitrios Trichopoulos Discovery and development of nucleoside and nucleotide reverse-transcriptase inhibitors Doctor's visit Drugs for acid-related disorders Effects of parasitic worms on the immune system Eleanor Montague Elisa Oricchio Elisabeth Binder Elixir sulfanilamide Environmental enteropathy Facial skeleton FOLFOXIRI François Fournier de Pescay Gaseous signaling molecules Glucose cycle Google Flu Trends Gross Motor Function Classification System Health care fraud Health effects of salt Hepatitis C and HIV coinfection History of tracheal intubation HIV and pregnancy Hua Eleanor Yu Ibuprofen brand names Infestation Integrated Management of Childhood Illness Intercurrent disease in pregnancy Karen C. Johnson Kathleen I. Pritchard Lea test Legionellales List of Legionnaires' disease outbreaks List of man-made mass poisoning incidents List of medical schools in Asia List of unsolved problems in medicine Marburgvirus Maria Abbracchio Medical advice Medical literature Medical privacy Mineral (nutrient) Monoamine releasing agent Mouth infection National Center for Immunization and Respiratory Diseases Needle sharing Outline of health Outline of health sciences Precautionary principle Privacy for research participants Procedural sedation and analgesia Rat Genome Database Reading disability Resource-based relative value scale Rotaviral enteritis Self-disorder Social immunity Splinter Tainted blood scandal (United Kingdom) Tebello Nyokong Testicular self-examination Transcultural nursing Translators Without Borders Tuberculosis in India Tuberculosis in relation to HIV Ulysses syndrome Weaning Weight management WHO Surgical Safety Checklist
Mid-importance predicted Top-importance	Low-importance predicted High-importance	Low-importance predicted Top-importance
Abortion ACE inhibitor Acetylcholinesterase inhibitor Acetylcysteine Acupuncture Adipose tissue Agoraphobia Alanine transaminase Alopecia areata Amiodarone Amitriptyline Amoxicillin Amoxicillin/clavulanic acid Ampicillin Anabolic steroid Androgen Angina pectoris Anthrax Anti-inflammatory Anticoagulant Antigen Aphasia Aripiprazole Artificial insemination Asphyxia Assisted suicide Ataxia Atrial fibrillation Atropine Autism spectrum Azathioprine B vitamins Betamethasone Bevacizumab Bile acid Biotin Bisphenol A Blood plasma Blood sugar Bloodletting Bone Botulinum toxin Brain death Brain–computer interface BRCA1 Brucellosis Bubonic plague Budesonide Buprenorphine Calcium Cannabidiol Carcinogen Cat-scratch disease Catatonia Catecholamine Celecoxib Cephalosporin Cetirizine Chikungunya Child development Chloramphenicol Chlorhexidine Chlorpromazine Cholecalciferol Circumcision Cisplatin Clarithromycin Clindamycin Clomifene Clonazepam Clotrimazole Codeine Color blindness Corticosteroid Crohn's disease CT scan Cyclophosphamide Decompression sickness Delusion Depression (mood) Dexamethasone Dextroamphetamine Dichlorodiphenyltrichloroethane Diethylstilbestrol Diltiazem Diphenhydramine Dissociative identity disorder Diuretic Donepezil Dopamine Down syndrome Doxycycline Drug overdose Dwarfism Eating disorder Edema Effects of cannabis Electric shock Electroconvulsive therapy Ephedrine Epidemiology Epigenetics Erysipelas Erythropoietin Escitalopram Ethanol Female genital mutilation Flatulence Folic acid Follicle-stimulating hormone Furosemide Gabapentin Gender dysphoria Ginkgo biloba Glucagon Glucose tolerance test Gonorrhea Guaifenesin Guillain–Barré syndrome Gynaecology Hair loss Hallucination Haloperidol Hangover Heart Heart rate Hematopoietic stem cell Heparin Homeopathy Hydrochlorothiazide Hydromorphone Hyoscine Hypercapnia Hypericum perforatum Hypertrophic cardiomyopathy Hypothermia Ibuprofen Imatinib In vitro fertilisation Infant Intellectual disability Intensive care unit Interferon Intersex Intravenous therapy Ipratropium bromide Isotretinoin Jaundice Karyotype Kava Ketamine Ketoconazole Lamotrigine Laudanum Levothyroxine Lidocaine Life expectancy Linezolid Lisdexamfetamine Lithium (medication) Loperamide Loratadine Lorazepam Losartan Louis Pasteur Luteinizing hormone Lysergic acid diethylamide Macular degeneration Mania Mannitol MDMA Median lethal dose Medicaid Medical cannabis Melanin Melatonin Memory Menstruation Meta-analysis Methadone Methanol Methicillin-resistant Staphylococcus aureus Methotrexate Methylene blue Methylphenidate Methylprednisolone Metoprolol Metronidazole Midazolam Midwife Mifepristone Minoxidil Misoprostol Modafinil Monoclonal antibody Morphine Mortality rate Multiple myeloma Muscle contraction Muscular dystrophy Myasthenia gravis Mycobacterium tuberculosis Naloxone Narcolepsy Necrosis Neuroplasticity Neurosis Neurosurgery Neutrophil Niacin Nicotinamide Nicotine Nifedipine Nitric oxide Norepinephrine Nystatin Obsessive–compulsive disorder Obstetrics Occupational therapy Omeprazole Ondansetron Opioid Optometry Oxycodone Paclitaxel Paracetamol Paraplegia Paroxetine Patient Protection and Affordable Care Act Peritonitis Personality disorder Phobia Physical therapy Placebo Plague (disease) Pleurisy Polio vaccine Positron emission tomography Potassium iodide Prednisolone Pregabalin Prion Propofol Propranolol Psychiatrist Psychoactive drug Psychotherapy Puberty Pulse Quality of life Quinine Randomized controlled trial Ranitidine Rape Repetitive strain injury Residency (medicine) Respiratory failure Retinol Riboflavin Ricin Sadistic personality disorder Salbutamol Savant syndrome Scabies Scurvy Self-harm Sense Sertraline Sexual intercourse Simvastatin Speech-language pathology Spironolactone Staphylococcus aureus Stillbirth Streptococcus Strychnine Substance abuse Sulfonamide (medicine) Syncope (medicine) T cell Tamoxifen Testicular cancer Tetrodotoxin Thiamine Topiramate Tourette syndrome Tretinoin Trichotillomania Ultrasound Universal health care Urination Urine Urology Vancomycin Vasopressin Verapamil Vitamin C Vitamin D Vitamin E Vitiligo Vomiting Warfarin William Harvey X chromosome Yellow fever Zolpidem	There are 1,002 Low-importance articles predicted as High-importance, which are too many to list. Here is a sample of 50 of them: Alexithymia Apoplexy Ascaris lumbricoides Athletic heart syndrome Audiology Ayurveda Benjamin Rush Cabergoline Certified first responder Craniosacral therapy Developmental verbal dyspraxia Echinococcus Epilepsy and driving Fordyce spots Francis Collins Functional electrical stimulation Glucagon-like peptide-1 HACEK organisms Haldane effect Hemagglutination HER2/neu Herd immunity Hereditary sensory and autonomic neuropathy High-protein diet History of cardiopulmonary resuscitation Immunoassay Implantable cardioverter-defibrillator Incremental cost-effectiveness ratio JAMA (journal) Liquefactive necrosis Low-density lipoprotein MIND diet Neonatal heel prick Nonunion Organic food Penetrance Personal health record POEMS syndrome Protein C Respiratory quotient Sclerosis (medicine) Separated shoulder Serum (blood) Streptococcus bovis Sybil (1976 film) The Hot Zone Transcranial direct-current stimulation Trench foot UpToDate Von Willebrand factor	Albinism Alexander Fleming Arsenic Benzene Brain natriuretic peptide Buspirone Cadaver Carbon tetrachloride Chloroform Desomorphine Dextromethorphan Dominance (genetics) Electrolyte Euphoria Fibrinogen Fluoride Fungus Galen Ghrelin Gluconeogenesis Gut flora Head transplant Health Insurance Portability and Accountability Act Hippocrates Human leukocyte antigen Humorism Hypersexuality Khat Lecithin Leptin Lisinopril Magnesium Massage Medicare (United States) Merck & Co. Mitragyna speciosa Mycoplasma Naltrexone Nurse practitioner Oliver Sacks Paraphilia Permethrin Pesticide Phentermine Piracetam Polychlorinated biphenyl Protozoa Reactive oxygen species Robert Koch Sarin Sexual addiction Sleepwalking Somatostatin Stem cell Sugar substitute Tissue plasminogen activator Vitamin A VX (nerve agent) Working memory Y chromosome

WPMED disambiguation pages

How many of the pages in my dataset are actually disambiguation pages? I need to go figure that out!

I ran this SQL query on Quarry to get a TSV of all disambiguation pages in WikiProject Medicine. There are 108 of them in total. Out of these, 18 have a different prediction from their actual WPMED importance rating. All of them are predicted to be Low-importance, 17 are rated Mid-importance, and one (Drug use) is rated High-importance. Only the last article shows up in our lists.

Inspecting the data I find that all of them have low number of inlinks, reasonably low number of views, and often none of the inlinks come from WPMED. I suspect the latter is because WPMED generally cleans up their articles and makes sure they do not link to disambiguation pages. In other words, a rating of Low-importance seems reasonable (although we might discuss why 18 of these appear to have importance ratings?)

Comparing these importance-rated disambiguation pages with those that did not have a rating suggests that all of them should have been marked as disambiguation pages and not gotten a rating. I went ahead and changed them, partly because that makes a dataset of WPMED importance ratings better.

WPMED communication

I posted to WPMED's assessment talk page with an introduction and some examples of articles we might want to talk about. Hopefully they'll have some comments.