That's not uncommon. What I would be concerned with is if they or someone else has gone to the trouble of using a connector block then could indeed be live or even live from somewhere else, as in switched live. Probably best just getting someone in to check rather than risk an accident or worse.
I would identify which circuit it is part of, likely part of a 2 way to 1 way lighting circuit. Isolate the supply at get CU, then remove the tape to see what goes where. A fluke voltage tester (something like the T90) will identify voltage with a single probe. Try and find out which other light switch it is connected, remembering a two way switch will show live at different points depending on the switch position at any one time. If you’re not confident with electricity get a sparkie in, if you are then identifying the circuits (redundant and those in use) will help clarify things for professionals. My own take is that the house is a diy horror show.
If you need to find a tradesperson to get your job done, please try our local search below, or if you are doing it yourself you can find suppliers local to you.
Select the supplier or trade you require, enter your location to begin your search.
Are you a trade or supplier? You can create your listing free at DIYnot Local