Dear brother,
I have no idea where you are from so I can only answer in principle, rather than address any particular issues or have in mind any particular people. It is probably better that way.
You ask why many saints have left the recovery. There are many reasons why a saint would leave the church they are in and most of those reasons the Lord would not honor. In general terms, the brother could be off, the church could be off, or both could be off. It is not easy to follow the Lord. We not only need a proper heart and a sincere desire to be one with the Lord, we also need a clear knowledge of the truth and an exercised spirit to sense the Lord's leading and speaking. If we hang on to one point of the truth and neglect another, we will make issues of things that should not be issues and end up having no way to go on in the church life. But it is also true that if a church takes a stand against something that the Lord would allow, then the church can make it impossible for some of the saints to go on. If this is the case then the church has moved away from the standing of the Body to something narrower. But on our part, we should be very, very careful about thinking we are right and that the church in our locality is wrong and that we are thus justified in making an issue and separating ourselves.
There are seven churches mentioned in Revelation chapters 2 and 3. Most of them were not in a good condition; some were definitely not good but the Lord did not call the overcomers to come out of them. In each place he gave a promise to those who would overcome in that place and situation. This is really hard but, to me, this is what it means to overcome. We would like a perfect church, one that is healthy and peaceful in every respect. One brother said that if you ever found such a church, it would no longer be perfect when you entered into it. This makes a lot of sense to me. We all are in the process of growth; we are not fully transformed; our knowledge of the truth is only in part; we are not always in spirit. Thus every one of us can and sometimes do become a problem to some of the other saints and even to the church.
We need to forbear and bear one another's shortcomings. We need to humble ourselves and repent and seek the Lord. When I was younger I didn't appreciate Daniel's prayer in Daniel chapter 9. I thought that Daniel was not like that, why did he confess the sins of others? Now I really appreciate this prayer. Daniel took the position of one of God's people and confessed the sins of the people. He did not take a position of thinking he was separate from and better than the others. Thus he was able to intercede for the people according to the Lord's heart and give the Lord a way to move among His people to recover some of them out of that poor situation.
Concerning specific people or situations, I have nothing to say. Of course there should always be room for a genuine expression of concern expressed with a proper spirit in a healthy way, but how can I say anything about something I know next to nothing about? I would have two issues with passing comment on situations in which I am not involved. First, I could not get a clear picture of the real situation without hearing both sides of the story and sensing the spirit with which each is speaking. The words by themselves can be misleading. Second, I am not the right one to pass judgment on someone else. I would rather leave that to the Lord. What I would be burdened to do is to help someone who is seeking help to find the Lord in the situation. It is most unlikely that I could solve for them whatever problem they face.
You talk about a shift of focus from Christ to the ministry. This, to me, should not be an issue. The proper ministry should bring us to Christ, help us to know Christ and His economy, and build us up in Christ. If ministry produces these effects, it should not be considered as something versus Christ. Yes, I receive light from the Lord directly from His Word, but this is not the only way the Lord enlightens me. Often, ministry of the Word helps me very much to know and experience Christ.
Dear brother, we all have a natural tendency to want others to agree with us and be the same as we are. This is against the oneness of the Body. There are some fundamental items of the faith, especially concerning the Person and redemptive work of the Lord Jesus which we can never compromise. The Lord receives us based on our believing into Him. But there are many, many things in the Bible concerning which we should not try to convince others to be the same as we are. If others try to convince us of things which we honestly, before the Lord do not see, that does not, by itself, justify us in rejecting or dividing ourselves from them. Our heart should be open and broad enough to receive all God's children. Of course, we need to follow and serve the Lord according to the vision and revelation we have received of Him and His economy, but our hearts should be open.
May the Lord continually lead you into a fuller knowledge and experience of Himself and of His economy.