Terminate job contract before starting?

I have signed a job offer but the company I work for has made a much better offer. I called the new company and they said they would take legal action against me. Can I cancel an employment contract before starting? It is an indefinite contract with start date 1 September and a probation period of 1 month