23

  • Machine Learning (11 marks)

    1. (6 marks) Describe the information gain calculations that are used in ID3 to to decide which attribute to "split" on.

      Answer: For solution, see lecture notes. Here's a concrete example, from question 3 of the Machine Learning Exercises.

      The attributes and their possible values are:
      texture: smooth wavy rough
      temperature: cold cool warm hot
      size: small medium large

      texturetemperaturesizeclass
      smoothcoldlargeyes
      smoothcoldsmallno
      smoothcoollargeyes
      smoothcoolsmallyes
      smoothhotsmallyes
      wavycoldmediumno
      wavyhotlargeyes
      roughcoldlargeno
      roughcoollargeyes
      roughhotsmallno
      roughwarmmediumyes