Title:A system of equations involving the fractional $p$-Laplacian and doubly critical nonlinearities

Abstract:This paper deals with existence of solutions to the following fractional $p$-Laplacian system of equations
\begin{equation*}
%\tag{$\mathcal P$}\label{MAT1}
\begin{cases}
(-\Delta_p)^s u =|u|^{p^*_s-2}u+ \frac{\gamma\alpha}{p_s^*}|u|^{\alpha-2}u|v|^{\beta}\;\;\text{in}\;\Omega,
(-\Delta_p)^s v =|v|^{p^*_s-2}v+ \frac{\gamma\beta}{p_s^*}|v|^{\beta-2}v|u|^{\alpha}\;\;\text{in}\;\Omega,
%
% u,\;v\in\wsp,
\end{cases}
\end{equation*}
where $s\in(0,1)$, $p\in(1,\infty)$ with $N>sp$, $\alpha,\,\beta>1$ such that $\alpha+\beta = p^*_s:=\frac{Np}{N-sp}$ and $\Omega=\mathbb{R}^N$ or smooth bounded domains in $\mathbb{R}^N$. For $\Omega=\mathbb{R}^N$ and $\gamma=1$, we show that any ground state solution of the above system has the form $(\lambda U, \tau\lambda V)$ for certain $\tau>0$ and $U,\;V$ are two positive ground state solutions of $(-\Delta_p)^s u =|u|^{p^*_s-2}u$ in $\mathbb{R}^N$. For all $\gamma>0$, we establish existence of a positive radial solution to the above system in balls. For $\Omega=\mathbb{R}^N$, we also establish existence of positive radial solutions to the above system in various ranges of $\gamma$.