Yes jessie you can, by why would you want to? lol
Only joking, but I do hate silk, it should be banned.
If its a skimmed coat, then I would do 2 very thin coats (miscoats) of your matt first.
When you have done your first miscoat, you will lightly sand down, or even do some filling, as you will see some imperfections, (turn on your lights), so you will be rubbing some of the paint off, then do another miscoat of your matt, as you want every part of your skim covered in the matt.
Then you can apply your silk
, but water down your first coat of silk just to be on the safe side.
You do realise that the silk will show up ever lump and bump on your plaster walls if there is any.
