Yes, I agree that the biggest problem is poorly maintained libraries. But if you don't use any third-party libraries, you'll still have to write a lot of native code. Flutter will be used mostly for UI. Does it make sense to use Flutter this way? Maybe, I'm not sure.

Generally, I think that successful usage of Flutter is about finding the balance between using libraries and writing your own code.