| 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222 |
- // SPDX-FileCopyrightText: Copyright 2018 yuzu Emulator Project
- // SPDX-License-Identifier: GPL-2.0-or-later
- #include "common/fiber.h"
- #include "common/microprofile.h"
- #include "common/scope_exit.h"
- #include "common/thread.h"
- #include "core/core.h"
- #include "core/core_timing.h"
- #include "core/cpu_manager.h"
- #include "core/hle/kernel/k_interrupt_manager.h"
- #include "core/hle/kernel/k_scheduler.h"
- #include "core/hle/kernel/k_thread.h"
- #include "core/hle/kernel/kernel.h"
- #include "core/hle/kernel/physical_core.h"
- #include "video_core/gpu.h"
- namespace Core {
- CpuManager::CpuManager(System& system_) : system{system_} {}
- CpuManager::~CpuManager() = default;
- void CpuManager::Initialize() {
- num_cores = is_multicore ? Core::Hardware::NUM_CPU_CORES : 1;
- gpu_barrier = std::make_unique<Common::Barrier>(num_cores + 1);
- for (std::size_t core = 0; core < num_cores; core++) {
- core_data[core].host_thread =
- std::jthread([this, core](std::stop_token token) { RunThread(token, core); });
- }
- }
- void CpuManager::Shutdown() {
- for (std::size_t core = 0; core < num_cores; core++) {
- if (core_data[core].host_thread.joinable()) {
- core_data[core].host_thread.request_stop();
- core_data[core].host_thread.join();
- }
- }
- }
- void CpuManager::GuestThreadFunction() {
- if (is_multicore) {
- MultiCoreRunGuestThread();
- } else {
- SingleCoreRunGuestThread();
- }
- }
- void CpuManager::IdleThreadFunction() {
- if (is_multicore) {
- MultiCoreRunIdleThread();
- } else {
- SingleCoreRunIdleThread();
- }
- }
- void CpuManager::ShutdownThreadFunction() {
- ShutdownThread();
- }
- void CpuManager::HandleInterrupt() {
- auto& kernel = system.Kernel();
- auto core_index = kernel.CurrentPhysicalCoreIndex();
- Kernel::KInterruptManager::HandleInterrupt(kernel, static_cast<s32>(core_index));
- }
- ///////////////////////////////////////////////////////////////////////////////
- /// MultiCore ///
- ///////////////////////////////////////////////////////////////////////////////
- void CpuManager::MultiCoreRunGuestThread() {
- // Similar to UserModeThreadStarter in HOS
- auto& kernel = system.Kernel();
- kernel.CurrentScheduler()->OnThreadStart();
- while (true) {
- auto* physical_core = &kernel.CurrentPhysicalCore();
- while (!physical_core->IsInterrupted()) {
- physical_core->Run();
- physical_core = &kernel.CurrentPhysicalCore();
- }
- HandleInterrupt();
- }
- }
- void CpuManager::MultiCoreRunIdleThread() {
- // Not accurate to HOS. Remove this entire method when singlecore is removed.
- // See notes in KScheduler::ScheduleImpl for more information about why this
- // is inaccurate.
- auto& kernel = system.Kernel();
- kernel.CurrentScheduler()->OnThreadStart();
- while (true) {
- auto& physical_core = kernel.CurrentPhysicalCore();
- if (!physical_core.IsInterrupted()) {
- physical_core.Idle();
- }
- HandleInterrupt();
- }
- }
- ///////////////////////////////////////////////////////////////////////////////
- /// SingleCore ///
- ///////////////////////////////////////////////////////////////////////////////
- void CpuManager::SingleCoreRunGuestThread() {
- auto& kernel = system.Kernel();
- kernel.CurrentScheduler()->OnThreadStart();
- while (true) {
- auto* physical_core = &kernel.CurrentPhysicalCore();
- if (!physical_core->IsInterrupted()) {
- physical_core->Run();
- physical_core = &kernel.CurrentPhysicalCore();
- }
- kernel.SetIsPhantomModeForSingleCore(true);
- system.CoreTiming().Advance();
- kernel.SetIsPhantomModeForSingleCore(false);
- PreemptSingleCore();
- HandleInterrupt();
- }
- }
- void CpuManager::SingleCoreRunIdleThread() {
- auto& kernel = system.Kernel();
- kernel.CurrentScheduler()->OnThreadStart();
- while (true) {
- PreemptSingleCore(false);
- system.CoreTiming().AddTicks(1000U);
- idle_count++;
- HandleInterrupt();
- }
- }
- void CpuManager::PreemptSingleCore(bool from_running_environment) {
- auto& kernel = system.Kernel();
- if (idle_count >= 4 || from_running_environment) {
- if (!from_running_environment) {
- system.CoreTiming().Idle();
- idle_count = 0;
- }
- kernel.SetIsPhantomModeForSingleCore(true);
- system.CoreTiming().Advance();
- kernel.SetIsPhantomModeForSingleCore(false);
- }
- current_core.store((current_core + 1) % Core::Hardware::NUM_CPU_CORES);
- system.CoreTiming().ResetTicks();
- kernel.Scheduler(current_core).PreemptSingleCore();
- // We've now been scheduled again, and we may have exchanged schedulers.
- // Reload the scheduler in case it's different.
- if (!kernel.Scheduler(current_core).IsIdle()) {
- idle_count = 0;
- }
- }
- void CpuManager::GuestActivate() {
- // Similar to the HorizonKernelMain callback in HOS
- auto& kernel = system.Kernel();
- auto* scheduler = kernel.CurrentScheduler();
- scheduler->Activate();
- UNREACHABLE();
- }
- void CpuManager::ShutdownThread() {
- auto& kernel = system.Kernel();
- auto* thread = kernel.GetCurrentEmuThread();
- auto core = is_multicore ? kernel.CurrentPhysicalCoreIndex() : 0;
- Common::Fiber::YieldTo(thread->GetHostContext(), *core_data[core].host_context);
- UNREACHABLE();
- }
- void CpuManager::RunThread(std::stop_token token, std::size_t core) {
- /// Initialization
- system.RegisterCoreThread(core);
- std::string name;
- if (is_multicore) {
- name = "CPUCore_" + std::to_string(core);
- } else {
- name = "CPUThread";
- }
- MicroProfileOnThreadCreate(name.c_str());
- Common::SetCurrentThreadName(name.c_str());
- Common::SetCurrentThreadPriority(Common::ThreadPriority::Critical);
- auto& data = core_data[core];
- data.host_context = Common::Fiber::ThreadToFiber();
- // Cleanup
- SCOPE_EXIT({
- data.host_context->Exit();
- MicroProfileOnThreadExit();
- });
- // Running
- if (!gpu_barrier->Sync(token)) {
- return;
- }
- if (!is_async_gpu && !is_multicore) {
- system.GPU().ObtainContext();
- }
- auto& kernel = system.Kernel();
- auto& scheduler = *kernel.CurrentScheduler();
- auto* thread = scheduler.GetSchedulerCurrentThread();
- Kernel::SetCurrentThread(kernel, thread);
- Common::Fiber::YieldTo(data.host_context, *thread->GetHostContext());
- }
- } // namespace Core
|