Paul makes an argument in 1 Corinthians 9 that even though we have liberty, it may be more loving not to exercise it. A quick 2015 for instance: you can drink, but it's more loving not to drink when it's front of a recovering alcoholic. But if you're in England and your Bible study meets at a pub, it may be more loving to have a pint with your mates.
People have taken that and run with it. You can guess which way that typically goes. "Well, I'll be all things to all people by _________." The blank gets filled in by any number of things that probably should raise an eyebrow as to conduct.
The question I always ask in situations like that is this: Paul was very clear about his intent - are you?
Paul's intent was to share the Gospel (9.23). Often times we hide behind "all things to all people" (9.22) to do what we want to do with the people we want to do it with and leave the sharing the Gospel out of it.
That's not why Jesus died on the cross and rose again. Our liberty is for others' liberation. We are free so we can share the Gospel.