Kanye West Has Had 'Explosive' Fights with Kris Jenner & Kim Kardashian Can't 'Control' Him: Sources

The last week has been a difficult one for the Kardashian-West family.

According to multiple sources, Kanye West has cut off contact with multiple people in his inner circle, including his managers, lawyers and closest friends — and he’s also had multiple arguments with his mother-in-law Kris Jenner.

“He’s had huge blow-ups with Kris. She sees how erratic he’s acting and is most concerned about her daughter’s brand. She’s also trying to be a good mother-in-law, so he’s having explosive issues with her too,” a source close to the situation tells PEOPLE exclusively. “Everyone is really, really worried.”

(However, another insider tells PEOPLE that “Kanye and Kris have never had a fight, adding, “Just because Kanye is having a strong opinion does not mean that he is mentally ill or headed for a breakdown. It’s unfair.”)

RELATED: Kanye West ‘Seems to Be on the Edge’ and ‘Is Very Hard to Deal with Right Now’: Sources

The rapper returned to Twitter but has been posting tweets that are increasingly worrisome to some of his loved ones. In one recent tweet, West suggested the need to “get rid of everything.”

A source close to the rapper contends that while West can be “eccentric and erratic,” not everyone sees his latest actions as cause for concern. Says the source: “A lot of this is just Kanye. He’s always been like that. He stirs the pot.”

RELATED VIDEO: Kim Kardashian Has Fun with Kanye’s Advice That ‘Sometimes You Need to Get Rid of Everything’

Kardashian West playfully responded to her husband on social media, but the source close to the situation says it was an attempt to take charge. “Kim is trying to control him and the situation, but he can’t be controlled,” says the source about the couple, who are parents to 3-month-old Chicago, Saint, 2, and North, 4½. “She’s trying her best to support him on social media and show a different side of things, but it’s just not working.”

“He genuinely believes he’s God and a genius and that he can do everything on his own. He has a great love for Kim, but in his mind he doesn’t think Kim is a genius, and he’s telling her he knows what he’s doing,” adds the source.

• Want to keep up with the latest from PEOPLE? Sign up for our daily newsletter to get our best stories of the day delivered straight to your inbox.

The source close to West, however, counters the notion that Kardashian West waded in on Twitter to “divert people.” Rather, “it’s more like [she’s saying] ‘You guys are off,'” says the source, who adds that the musician has been busy in the studio. “She is always loving towards Kanye, always concerned with whatever he’s concerned about, always in his corner.”

West also had an uncomfortable call recently with Hot 97 host Ebro Darden, who claims West reiterated his support for President Donald Trump and discussed anti-Black Lives Matter commentator Candace Owen’s appeal. In audio released Tuesday morning by Hot 97, West can be heard telling Ebro “I love you” repeatedly.

A West insider says the entertainer, 40, is “sleeping very little” and “texting at all hours of the day or night” and has been exhausting those around him.

“It’s very hard to deal with,” says the insider. “He’s all over the place. If you can’t be part of his creative genius, he’ll cut you loose. That’s what he says.”

The source close to West — who says the rapper “seemed great” and “super positive” on the phone last week — acknowledges the star is someone who “revs really high and is really active and expends a lot of energy” on his projects, but insists that’s just how he is.

“That’s part of being Kanye,” says the source, who feels West was recently taken advantage of for radio publicity. “He’s willing to take risks with his public persona. He doesn’t take it as serious as the internet takes it.”

RELATED: Kanye West and Daughter North Dance (with Dolls!) to Michael Jackson’s Songs ‘All Morning’

In late 2016, West was hospitalized for exhaustion after canceling his Saint Pablo tour. Fans saw Kardashian West, 37, break down on Keeping Up with the Kardashians earlier this year as footage from that trying time finally aired.

“I don’t even know what’s going on right now, it’s getting pretty hectic at home,” Kim said on the show. “Everyone is just getting really worried.”

“I’m not in the mood to get into it right now… but it will be okay,” she told her family. “Everything will be okay. It’s forcing him to take much-needed time off, which he needs. I think that will be really good for him. I feel a sense of responsibility just with the pressure of taking care of everything. Even after the robbery and everything, it’s just I’ve been staying home and I’ve been looking to him to just take care of everything while I stay home.”

“He just never takes time off,” she continued. “I’m just so drained. There was one moment where I just sat there and took deep breaths.”