A heat advisory has been issued in parts of Massachusetts through the end of the week as temperatures start to rise.