You acted wisely. It is a mistake to agree to a polygraph interrogation in any criminal investigation. It's a ruse used by police to get a suspect into an interrogation room without a lawyer present. It's entirely possible that your "failing" the "test" was part of the interrogation plan.

If your lawyer somehow advises you to submit to the polygraph "test," then you would be smart to find a more competent lawyer.