Take more of the paper off. Then push against either side of the crack, if you cannot see any movement, it will probably be fine to just fill over it.
If there is any movement, I would enlarge the gap slightly, brush in PVA (it can help lock small sections of plaster in place), then fill with...