Health Secretary Wes Streeting has said there is a "risk of disruption" in the NHS as he attempts to overhaul the service and reduce waste, but has promised long-term improvements.
On Thursday, Streeting announced NHS England, a public administrative body, would be scrapped to save money and give ministers more control of health services.
The Labour government expects the move will take two years and save hundreds of millions of pounds that can be spent on frontline NHS services.
Appearing on the BBCs Sunday with Laura Kuenssberg programme, Streeting defended the reforms but admitted there would be challenges.
When asked about the impact on patient care, he said: "Of course there are always up-front costs. And yes there is always a risk of disruption."
Streeting said former health secretaries had "not been prepared to take on those sorts of challenges" and argued NHS England "was set up to shield politicians like me from responsibility".
He said: "Ive seen waste, inefficiency and duplication. So of course we should go after that."
When asked for a second time if patient care would be disrupted by the governments reorganisation of the NHS, Streeting promised to deliver improvements and said waiting lists for treatment had already been falling.
The government said its main reasons for abolishing NHS England were to "cut bureaucracy" and reform how health services operate.
It dubbed NHS England "the worlds largest quango" - the term used to describe publicly funded organisations at arms length from the government
Currently, NHS England oversees the health service, working with government to agree funding and priorities, as well as monitoring the performance of local NHS services.
Under the changes, the organisation will be brought into the Department of Health and Social Care (DHSC), which is headed by Streeting.
The reforms will not impact anyones access to the NHS, with the health service remaining free at the point of use.
The government said it expected around half of the jobs at NHS England and DHSC to go - around 9,000 administrative roles.
Writing in the Telegraph, Streeting suggested scrapping NHS England was "the beginning, not the end" and said he would continue "slashing bloated bureaucracy".
The health secretary tasked Penny Dash, who was made chairman of NHS England at the start of this month, with carrying out a review of bureaucracy.
Speaking to the BBC, Streeting would not be drawn on which bureaucratic NHS organisations he would consider axing.
But he said he was "going after the bureaucracy not the people who work in it".