Scribd Logo
Încărcați

Bine ați venit la Scribd!

  • Explanation On A3

    Încărcat de

    Basit Jasani
    8 vizualizări1 pagină
    Most of the submission fall into two kinds of errors: 1. Over-fitting - is a major problem in machine learning, this problem occur if we try to come ups with the model that utilize all the data(data+noise). Under-fitting is a problem with students who intentionally uses few features from the example to build our model. It means it will give both low accuracy on training and testing datasets. A good fitmodel is required as a solution to this problem, almost all

    Descriere originală:

    Titlu original

    Explanation+on+A3

    Drepturi de autor

    © © All Rights Reserved

    Formate disponibile

    PDF, TXT sau citiți online pe Scribd

    Vi se pare util acest document?

    Este necorespunzător acest conținut?

    Raportați acest document
    Most of the submission fall into two kinds of errors: 1. Over-fitting - is a major problem in machine learning, this problem occur if we try to come ups with the model that utilize all the data(data+noise). Under-fitting is a problem with students who intentionally uses few features from the example to build our model. It means it will give both low accuracy on training and testing datasets. A good fitmodel is required as a solution to this problem, almost all

    Drepturi de autor:

    © All Rights Reserved
    Descărcați ca PDF, TXT sau citiți online pe Scribd
    Indicator pentru conținut neadecvat
    8 vizualizări1 pagină

    Explanation On A3

    Încărcat de

    Basit Jasani
    Most of the submission fall into two kinds of errors: 1. Over-fitting - is a major problem in machine learning, this problem occur if we try to come ups with the model that utilize all the data(data+noise). Under-fitting is a problem with students who intentionally uses few features from the example to build our model. It means it will give both low accuracy on training and testing datasets. A good fitmodel is required as a solution to this problem, almost all

    Drepturi de autor:

    © All Rights Reserved
    Descărcați ca PDF, TXT sau citiți online pe Scribd
    Indicator pentru conținut neadecvat
    din 1

    ExplanationonA3TextClassificationtask

    IwanttogiveanexplanationonA3TextClassificationtask,mostofthesubmissionfallintotwokinds
    oferrors:
    1. Overfittingisamajorprobleminmachinelearning,thisproblemoccurifwetryto
    comeupswiththemodelthatutilizeallthedata(data+noise).Hencethemodelthatwe
    learnhasmorevariancefromthedata,itcanbehaveverybadlyontheunseendata.
    Mostofthepeopleperformoverfittingbyutilizingmorefeaturesthatarenottruly
    basedontheclassificationproblem.Theintentionofthisassignmentistolearnthe
    relevantfeaturesfromthedata.Themodeltrainedbyoverfittingsimplygrabthenon
    relevantfeaturesaswell.Ihavetestedthemodelsuchproducedonthenewdataset,
    anditgivesaccuracyofabout32%.<Thisistheproblemwithstudentswhohaveused
    morefeatures(alldistinctwords,wordsmorethan100,lessfrequentwords,etc).You
    canjudgethistypeofproblemwhenyouhaveTrainingErrorislow,butvalidationerror
    ishigh.
    2. Underfittingisalsoamajorproblembutnotasmajorasoverfitting.Inthisproblem
    weintentionallyusesfewfeaturesfromtheexampletobuildourmodel.Hencedueto
    thislimitedfeaturespaceovermodelisunderfit.Itmeansitwillgivebothlowaccuracy
    ontrainingandtestingdatasets.itmeanswehaveuseverysimplemodeltofitinour
    data,likefittingwithastraightline.Ihavetestedthemodelsuchproducedonthenew
    dataset,anditgivesaccuracyofabout29%.<Thisistheproblemwithstudentswho
    haveusedveryfewfeatures(toptenwordsfromthedataset).Youcanjudgethistype
    ofproblemwhenyouhaveTrainingErrorislow,butvalidationerrorislow.

    Agoodfitmodelisrequiredasasolutiontothisproblem,almostallarefailedtograbthisidea.So,
    whatarethegoodfeaturesforthisassignmentthatperformbothtrainingandtestingerrortoa
    minimum.Trytocomeupwithmostrelevantfeatures(with10+features)forthetwoclasses:
    CameraandCaralongwithahierarchicalarrangementofgeneraldescriptorslike:Category,Model,
    Configuration,Attributes,andusage.Withthesehierarchicalfeatureswewillhaveanaccuracyofabout
    92%onbothtrainingandtestdatasets.

    S-ar putea să vă placă și