You are not logged in.

#1 2017-08-12 12:58:14

setzer22
Member
Registered: 2014-07-26
Posts: 47

GPU performance degrades after suspend

Hello everyone,

I am using bumblebee on my Nvidia Optimus laptop (Intel integrated + Nvidia dedicated cards). Whenever I put my system in suspension state (that is suspend to ram, hibernation works fine), running applications with my dedicated card through optirun stops working fine, since I get a huge performance degradation. By huge I mean that a game can go from running smoothly at 60FPS to falling back to 5FPS. I can replicate this every time I suspend to ram and resume my system. Rebooting the system fixes this until I suspend again.

I have been able to test this issue in many different games and applications, so this seems to be nothing application-related.

EDIT: I should also mention that I can consistently replicate this with all suspend methods (systemctl suspend, s2ram from uswsusp and even writing directly to /sys/power/state)

I have read the nvidia troubleshooting page, which seems to describe my issue (https://wiki.archlinux.org/index.php/NV … om_suspend). However, the suggested fix didn't work. I added the following file in /etc/modprobe.d/nvidia.conf to no avail:

options nvidia NVreg_RegisterForACPIEvents=1 NVreg_EnableMSI=1

Maybe this fix is specific to the normal nvidia driver usage, and bumblebee ignores the kernel module options in modprobe.d, could that be the problem? Is there a way to specify these options on bumblebee?

Or maybe I'm looking at the wrong place. Any tips to further debug this?

EDIT: There are a couple more "interesting" symptoms related to this issue. On one hand, this laptop has another issue where it will get stuck in some kind of loop on shutdown and never power off completely. Oddly enough, if I suspend and resume my system, getting the bad GPU performance I describe, shutdown works fine. Since all of this is related to ACPI, I also felt I should include these ACPI error messages that I'm getting during boot:

Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: Method parse/execution failed [\_SB.PCI0.LPCB.EC._REG] (Node ffffa0c81f1275a0), AE_NOT_EXIST (20170303/psparse-543)
Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: Region EmbeddedControl (ID=3) has no handler (20170303/exfldio-299)
Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: No handler for Region [EC__] (ffffa0c81f128120) [EmbeddedControl] (20170303/evregion-166)
Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: Method parse/execution failed [\_SB.PCI0.LPCB.EC._REG] (Node ffffa0c81f1275a0), AE_NOT_EXIST (20170303/psparse-543)
Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: Region EmbeddedControl (ID=3) has no handler (20170303/exfldio-299)
Aug 12 14:09:44 jsf-Arch kernel: ACPI Error: No handler for Region [EC__] (ffffa0c81f128120) [EmbeddedControl] (20170303/evregion-166)
Aug 12 14:09:53 jsf-Arch kernel: ACPI Error: Method parse/execution failed [\_SB.PCI0.PEG0.PEGP.DD02._BCL] (Node ffffa0c81f1570a0), AE_NOT_FOUND (20170303/psparse-543)
Aug 12 14:09:53 jsf-Arch kernel: ACPI Error: [\_SB_.PCI0.GFX0.DD02._BCL] Namespace lookup failure, AE_NOT_FOUND (20170303/psargs-364)

Thank you.

Last edited by setzer22 (2017-08-12 13:26:19)

Offline

#2 2017-08-12 14:54:07

seth
Member
Registered: 2012-09-03
Posts: 51,056

Offline

#3 2017-08-12 14:57:06

setzer22
Member
Registered: 2014-07-26
Posts: 47

Re: GPU performance degrades after suspend

Thanks for your reply,

I had forgotten to mention that I read that wiki page and already have acpi and acpi_call installed. So that doesn't seem to be the issue.

Offline

#4 2017-08-12 15:02:51

seth
Member
Registered: 2012-09-03
Posts: 51,056

Offline

#5 2017-08-12 19:07:46

setzer22
Member
Registered: 2014-07-26
Posts: 47

Re: GPU performance degrades after suspend

That is supposed to fix the card not activating after suspension. My card is re-activated, but performs poorly. It's not the same issue. Nevertheless, I've tried it and it didn't work.

Also, no offense. I realize it's common to have posters who haven't read the wiki, but I can assure I've read the wiki pages on Nividia, Optimus and Bumblebee and the most common issues and troubleshooting before asking this.

Thanks

Offline

#6 2017-08-12 20:42:30

seth
Member
Registered: 2012-09-03
Posts: 51,056

Re: GPU performance degrades after suspend

Sorry (but yes, referring to the wiki is usually a solution ;-)

Is the nvidia module loaded when going S3 (and is that relevant)?

If you haven't yet, ensure you're indeed using the GPU (optirun glxinfo) and then have a look at nvidia-smi (also post the output to record your actual GPU and driver version)
Notably have a look at performance and power settings and whether they adapt on load.

Next see whether a GPU reset helps (nvidia-smi -r)

Lastly, restart the X11 server and ensure the nvidia module gets unloaded at some point.

Offline

#7 2017-08-13 09:01:13

setzer22
Member
Registered: 2014-07-26
Posts: 47

Re: GPU performance degrades after suspend

Thanks for your reply!

Is the nvidia module loaded when going S3 (and is that relevant)?

Is there a way I can run lsmod to check that after issuing a suspend command? My laptop has a hardware LED that turns red when the GPU is active, and I can confirm it turns red whenever I issue a suspend command, but I cannot confirm that the nvidia module is being loaded by the kernel.

If you haven't yet, ensure you're indeed using the GPU (optirun glxinfo) and then have a look at nvidia-smi (also post the output to record your actual GPU and driver version)
Notably have a look at performance and power settings and whether they adapt on load.

I can confirm the card works both after and before suspend (optirun glxinfo works, and also does optirun nvidia-smi). This is the output from glxinfo. There are no differences before and after suspend:

name of display: :0
display: :0  screen: 0
direct rendering: Yes
server glx vendor string: VirtualGL
server glx version string: 1.4
server glx extensions:
    GLX_ARB_create_context, GLX_ARB_create_context_profile, 
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_import_context, 
    GLX_EXT_swap_control, GLX_EXT_texture_from_pixmap, GLX_EXT_visual_info, 
    GLX_EXT_visual_rating, GLX_NV_swap_group, GLX_SGIX_fbconfig, 
    GLX_SGIX_pbuffer, GLX_SGI_make_current_read, GLX_SGI_swap_control, 
    GLX_SUN_get_transparent_index
client glx vendor string: VirtualGL
client glx version string: 1.4
client glx extensions:
    GLX_ARB_create_context, GLX_ARB_create_context_profile, 
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_import_context, 
    GLX_EXT_swap_control, GLX_EXT_texture_from_pixmap, GLX_EXT_visual_info, 
    GLX_EXT_visual_rating, GLX_NV_swap_group, GLX_SGIX_fbconfig, 
    GLX_SGIX_pbuffer, GLX_SGI_make_current_read, GLX_SGI_swap_control, 
    GLX_SUN_get_transparent_index
GLX version: 1.4
GLX extensions:
    GLX_ARB_create_context, GLX_ARB_create_context_profile, 
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_import_context, 
    GLX_EXT_swap_control, GLX_EXT_texture_from_pixmap, GLX_EXT_visual_info, 
    GLX_EXT_visual_rating, GLX_NV_swap_group, GLX_SGIX_fbconfig, 
    GLX_SGIX_pbuffer, GLX_SGI_make_current_read, GLX_SGI_swap_control, 
    GLX_SUN_get_transparent_index
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: GeForce GTX 860M/PCIe/SSE2
OpenGL core profile version string: 4.5.0 NVIDIA 384.59
OpenGL core profile shading language version string: 4.50 NVIDIA
OpenGL core profile context flags: (none)
OpenGL core profile profile mask: core profile
OpenGL core profile extensions:
    GL_AMD_multi_draw_indirect, GL_AMD_seamless_cubemap_per_texture, 
    GL_ARB_ES2_compatibility, GL_ARB_ES3_1_compatibility, 
    GL_ARB_ES3_2_compatibility, GL_ARB_ES3_compatibility, 
    GL_ARB_arrays_of_arrays, GL_ARB_base_instance, GL_ARB_bindless_texture, 
    GL_ARB_blend_func_extended, GL_ARB_buffer_storage, 
    GL_ARB_clear_buffer_object, GL_ARB_clear_texture, GL_ARB_clip_control, 
    GL_ARB_color_buffer_float, GL_ARB_compressed_texture_pixel_storage, 
    GL_ARB_compute_shader, GL_ARB_compute_variable_group_size, 
    GL_ARB_conditional_render_inverted, GL_ARB_conservative_depth, 
    GL_ARB_copy_buffer, GL_ARB_copy_image, GL_ARB_cull_distance, 
    GL_ARB_debug_output, GL_ARB_depth_buffer_float, GL_ARB_depth_clamp, 
    GL_ARB_depth_texture, GL_ARB_derivative_control, 
    GL_ARB_direct_state_access, GL_ARB_draw_buffers, 
    GL_ARB_draw_buffers_blend, GL_ARB_draw_elements_base_vertex, 
    GL_ARB_draw_indirect, GL_ARB_draw_instanced, GL_ARB_enhanced_layouts, 
    GL_ARB_explicit_attrib_location, GL_ARB_explicit_uniform_location, 
    GL_ARB_fragment_coord_conventions, GL_ARB_fragment_layer_viewport, 
    GL_ARB_fragment_program, GL_ARB_fragment_program_shadow, 
    GL_ARB_fragment_shader, GL_ARB_framebuffer_no_attachments, 
    GL_ARB_framebuffer_object, GL_ARB_framebuffer_sRGB, 
    GL_ARB_geometry_shader4, GL_ARB_get_program_binary, 
    GL_ARB_get_texture_sub_image, GL_ARB_gl_spirv, GL_ARB_gpu_shader5, 
    GL_ARB_gpu_shader_fp64, GL_ARB_gpu_shader_int64, GL_ARB_half_float_pixel, 
    GL_ARB_half_float_vertex, GL_ARB_imaging, GL_ARB_indirect_parameters, 
    GL_ARB_instanced_arrays, GL_ARB_internalformat_query, 
    GL_ARB_internalformat_query2, GL_ARB_invalidate_subdata, 
    GL_ARB_map_buffer_alignment, GL_ARB_map_buffer_range, GL_ARB_multi_bind, 
    GL_ARB_multi_draw_indirect, GL_ARB_multisample, GL_ARB_multitexture, 
    GL_ARB_occlusion_query, GL_ARB_occlusion_query2, 
    GL_ARB_parallel_shader_compile, GL_ARB_pipeline_statistics_query, 
    GL_ARB_pixel_buffer_object, GL_ARB_point_parameters, GL_ARB_point_sprite, 
    GL_ARB_program_interface_query, GL_ARB_provoking_vertex, 
    GL_ARB_query_buffer_object, GL_ARB_robust_buffer_access_behavior, 
    GL_ARB_robustness, GL_ARB_sample_shading, GL_ARB_sampler_objects, 
    GL_ARB_seamless_cube_map, GL_ARB_seamless_cubemap_per_texture, 
    GL_ARB_separate_shader_objects, GL_ARB_shader_atomic_counter_ops, 
    GL_ARB_shader_atomic_counters, GL_ARB_shader_ballot, 
    GL_ARB_shader_bit_encoding, GL_ARB_shader_clock, 
    GL_ARB_shader_draw_parameters, GL_ARB_shader_group_vote, 
    GL_ARB_shader_image_load_store, GL_ARB_shader_image_size, 
    GL_ARB_shader_objects, GL_ARB_shader_precision, 
    GL_ARB_shader_storage_buffer_object, GL_ARB_shader_subroutine, 
    GL_ARB_shader_texture_image_samples, GL_ARB_shader_texture_lod, 
    GL_ARB_shading_language_100, GL_ARB_shading_language_420pack, 
    GL_ARB_shading_language_include, GL_ARB_shading_language_packing, 
    GL_ARB_shadow, GL_ARB_sparse_buffer, GL_ARB_sparse_texture, 
    GL_ARB_stencil_texturing, GL_ARB_sync, GL_ARB_tessellation_shader, 
    GL_ARB_texture_barrier, GL_ARB_texture_border_clamp, 
    GL_ARB_texture_buffer_object, GL_ARB_texture_buffer_object_rgb32, 
    GL_ARB_texture_buffer_range, GL_ARB_texture_compression, 
    GL_ARB_texture_compression_bptc, GL_ARB_texture_compression_rgtc, 
    GL_ARB_texture_cube_map, GL_ARB_texture_cube_map_array, 
    GL_ARB_texture_env_add, GL_ARB_texture_env_combine, 
    GL_ARB_texture_env_crossbar, GL_ARB_texture_env_dot3, 
    GL_ARB_texture_float, GL_ARB_texture_gather, 
    GL_ARB_texture_mirror_clamp_to_edge, GL_ARB_texture_mirrored_repeat, 
    GL_ARB_texture_multisample, GL_ARB_texture_non_power_of_two, 
    GL_ARB_texture_query_levels, GL_ARB_texture_query_lod, 
    GL_ARB_texture_rectangle, GL_ARB_texture_rg, GL_ARB_texture_rgb10_a2ui, 
    GL_ARB_texture_stencil8, GL_ARB_texture_storage, 
    GL_ARB_texture_storage_multisample, GL_ARB_texture_swizzle, 
    GL_ARB_texture_view, GL_ARB_timer_query, GL_ARB_transform_feedback2, 
    GL_ARB_transform_feedback3, GL_ARB_transform_feedback_instanced, 
    GL_ARB_transform_feedback_overflow_query, GL_ARB_transpose_matrix, 
    GL_ARB_uniform_buffer_object, GL_ARB_vertex_array_bgra, 
    GL_ARB_vertex_array_object, GL_ARB_vertex_attrib_64bit, 
    GL_ARB_vertex_attrib_binding, GL_ARB_vertex_buffer_object, 
    GL_ARB_vertex_program, GL_ARB_vertex_shader, 
    GL_ARB_vertex_type_10f_11f_11f_rev, GL_ARB_vertex_type_2_10_10_10_rev, 
    GL_ARB_viewport_array, GL_ARB_window_pos, GL_ATI_draw_buffers, 
    GL_ATI_texture_float, GL_ATI_texture_mirror_once, 
    GL_EXTX_framebuffer_mixed_formats, GL_EXT_Cg_shader, GL_EXT_abgr, 
    GL_EXT_bgra, GL_EXT_bindable_uniform, GL_EXT_blend_color, 
    GL_EXT_blend_equation_separate, GL_EXT_blend_func_separate, 
    GL_EXT_blend_minmax, GL_EXT_blend_subtract, GL_EXT_compiled_vertex_array, 
    GL_EXT_depth_bounds_test, GL_EXT_direct_state_access, 
    GL_EXT_draw_buffers2, GL_EXT_draw_instanced, GL_EXT_draw_range_elements, 
    GL_EXT_fog_coord, GL_EXT_framebuffer_blit, GL_EXT_framebuffer_multisample, 
    GL_EXT_framebuffer_multisample_blit_scaled, GL_EXT_framebuffer_object, 
    GL_EXT_framebuffer_sRGB, GL_EXT_geometry_shader4, 
    GL_EXT_gpu_program_parameters, GL_EXT_gpu_shader4, 
    GL_EXT_import_sync_object, GL_EXT_multi_draw_arrays, 
    GL_EXT_packed_depth_stencil, GL_EXT_packed_float, GL_EXT_packed_pixels, 
    GL_EXT_pixel_buffer_object, GL_EXT_point_parameters, 
    GL_EXT_polygon_offset_clamp, GL_EXT_provoking_vertex, 
    GL_EXT_rescale_normal, GL_EXT_secondary_color, 
    GL_EXT_separate_shader_objects, GL_EXT_separate_specular_color, 
    GL_EXT_shader_image_load_formatted, GL_EXT_shader_image_load_store, 
    GL_EXT_shader_integer_mix, GL_EXT_shadow_funcs, GL_EXT_stencil_two_side, 
    GL_EXT_stencil_wrap, GL_EXT_texture3D, GL_EXT_texture_array, 
    GL_EXT_texture_buffer_object, GL_EXT_texture_compression_dxt1, 
    GL_EXT_texture_compression_latc, GL_EXT_texture_compression_rgtc, 
    GL_EXT_texture_compression_s3tc, GL_EXT_texture_cube_map, 
    GL_EXT_texture_edge_clamp, GL_EXT_texture_env_add, 
    GL_EXT_texture_env_combine, GL_EXT_texture_env_dot3, 
    GL_EXT_texture_filter_anisotropic, GL_EXT_texture_integer, 
    GL_EXT_texture_lod, GL_EXT_texture_lod_bias, GL_EXT_texture_mirror_clamp, 
    GL_EXT_texture_object, GL_EXT_texture_sRGB, GL_EXT_texture_sRGB_decode, 
    GL_EXT_texture_shared_exponent, GL_EXT_texture_storage, 
    GL_EXT_texture_swizzle, GL_EXT_timer_query, GL_EXT_transform_feedback2, 
    GL_EXT_vertex_array, GL_EXT_vertex_array_bgra, GL_EXT_vertex_attrib_64bit, 
    GL_EXT_window_rectangles, GL_EXT_x11_sync_object, GL_IBM_rasterpos_clip, 
    GL_IBM_texture_mirrored_repeat, GL_KHR_blend_equation_advanced, 
    GL_KHR_blend_equation_advanced_coherent, GL_KHR_context_flush_control, 
    GL_KHR_debug, GL_KHR_no_error, GL_KHR_robust_buffer_access_behavior, 
    GL_KHR_robustness, GL_KTX_buffer_region, GL_NVX_conditional_render, 
    GL_NVX_gpu_memory_info, GL_NVX_nvenc_interop, GL_NV_ES1_1_compatibility, 
    GL_NV_ES3_1_compatibility, GL_NV_alpha_to_coverage_dither_control, 
    GL_NV_bindless_multi_draw_indirect, 
    GL_NV_bindless_multi_draw_indirect_count, GL_NV_bindless_texture, 
    GL_NV_blend_equation_advanced, GL_NV_blend_equation_advanced_coherent, 
    GL_NV_blend_square, GL_NV_command_list, GL_NV_compute_program5, 
    GL_NV_conditional_render, GL_NV_copy_depth_to_color, GL_NV_copy_image, 
    GL_NV_depth_buffer_float, GL_NV_depth_clamp, GL_NV_draw_texture, 
    GL_NV_draw_vulkan_image, GL_NV_explicit_multisample, GL_NV_fence, 
    GL_NV_float_buffer, GL_NV_fog_distance, GL_NV_fragment_program, 
    GL_NV_fragment_program2, GL_NV_fragment_program_option, 
    GL_NV_framebuffer_multisample_coverage, GL_NV_geometry_shader4, 
    GL_NV_gpu_program4, GL_NV_gpu_program4_1, GL_NV_gpu_program5, 
    GL_NV_gpu_program5_mem_extended, GL_NV_gpu_program_fp64, 
    GL_NV_gpu_shader5, GL_NV_half_float, GL_NV_internalformat_sample_query, 
    GL_NV_light_max_exponent, GL_NV_multisample_coverage, 
    GL_NV_multisample_filter_hint, GL_NV_occlusion_query, 
    GL_NV_packed_depth_stencil, GL_NV_parameter_buffer_object, 
    GL_NV_parameter_buffer_object2, GL_NV_path_rendering, 
    GL_NV_pixel_data_range, GL_NV_point_sprite, GL_NV_primitive_restart, 
    GL_NV_register_combiners, GL_NV_register_combiners2, 
    GL_NV_robustness_video_memory_purge, GL_NV_shader_atomic_counters, 
    GL_NV_shader_atomic_float, GL_NV_shader_atomic_int64, 
    GL_NV_shader_buffer_load, GL_NV_shader_storage_buffer_object, 
    GL_NV_shader_thread_group, GL_NV_shader_thread_shuffle, 
    GL_NV_texgen_reflection, GL_NV_texture_barrier, 
    GL_NV_texture_compression_vtc, GL_NV_texture_env_combine4, 
    GL_NV_texture_multisample, GL_NV_texture_rectangle, GL_NV_texture_shader, 
    GL_NV_texture_shader2, GL_NV_texture_shader3, GL_NV_transform_feedback, 
    GL_NV_transform_feedback2, GL_NV_uniform_buffer_unified_memory, 
    GL_NV_vdpau_interop, GL_NV_vertex_array_range, GL_NV_vertex_array_range2, 
    GL_NV_vertex_attrib_integer_64bit, GL_NV_vertex_buffer_unified_memory, 
    GL_NV_vertex_program, GL_NV_vertex_program1_1, GL_NV_vertex_program2, 
    GL_NV_vertex_program2_option, GL_NV_vertex_program3, GL_S3_s3tc, 
    GL_SGIS_generate_mipmap, GL_SGIS_texture_lod, GL_SGIX_depth_texture, 
    GL_SGIX_shadow, GL_SUN_slice_accum

OpenGL version string: 4.5.0 NVIDIA 384.59
OpenGL shading language version string: 4.50 NVIDIA
OpenGL context flags: (none)
OpenGL profile mask: (none)
OpenGL extensions:
    GL_AMD_multi_draw_indirect, GL_AMD_seamless_cubemap_per_texture, 
    GL_ARB_ES2_compatibility, GL_ARB_ES3_1_compatibility, 
    GL_ARB_ES3_2_compatibility, GL_ARB_ES3_compatibility, 
    GL_ARB_arrays_of_arrays, GL_ARB_base_instance, GL_ARB_bindless_texture, 
    GL_ARB_blend_func_extended, GL_ARB_buffer_storage, 
    GL_ARB_clear_buffer_object, GL_ARB_clear_texture, GL_ARB_clip_control, 
    GL_ARB_color_buffer_float, GL_ARB_compatibility, 
    GL_ARB_compressed_texture_pixel_storage, GL_ARB_compute_shader, 
    GL_ARB_compute_variable_group_size, GL_ARB_conditional_render_inverted, 
    GL_ARB_conservative_depth, GL_ARB_copy_buffer, GL_ARB_copy_image, 
    GL_ARB_cull_distance, GL_ARB_debug_output, GL_ARB_depth_buffer_float, 
    GL_ARB_depth_clamp, GL_ARB_depth_texture, GL_ARB_derivative_control, 
    GL_ARB_direct_state_access, GL_ARB_draw_buffers, 
    GL_ARB_draw_buffers_blend, GL_ARB_draw_elements_base_vertex, 
    GL_ARB_draw_indirect, GL_ARB_draw_instanced, GL_ARB_enhanced_layouts, 
    GL_ARB_explicit_attrib_location, GL_ARB_explicit_uniform_location, 
    GL_ARB_fragment_coord_conventions, GL_ARB_fragment_layer_viewport, 
    GL_ARB_fragment_program, GL_ARB_fragment_program_shadow, 
    GL_ARB_fragment_shader, GL_ARB_framebuffer_no_attachments, 
    GL_ARB_framebuffer_object, GL_ARB_framebuffer_sRGB, 
    GL_ARB_geometry_shader4, GL_ARB_get_program_binary, 
    GL_ARB_get_texture_sub_image, GL_ARB_gl_spirv, GL_ARB_gpu_shader5, 
    GL_ARB_gpu_shader_fp64, GL_ARB_gpu_shader_int64, GL_ARB_half_float_pixel, 
    GL_ARB_half_float_vertex, GL_ARB_imaging, GL_ARB_indirect_parameters, 
    GL_ARB_instanced_arrays, GL_ARB_internalformat_query, 
    GL_ARB_internalformat_query2, GL_ARB_invalidate_subdata, 
    GL_ARB_map_buffer_alignment, GL_ARB_map_buffer_range, GL_ARB_multi_bind, 
    GL_ARB_multi_draw_indirect, GL_ARB_multisample, GL_ARB_multitexture, 
    GL_ARB_occlusion_query, GL_ARB_occlusion_query2, 
    GL_ARB_parallel_shader_compile, GL_ARB_pipeline_statistics_query, 
    GL_ARB_pixel_buffer_object, GL_ARB_point_parameters, GL_ARB_point_sprite, 
    GL_ARB_program_interface_query, GL_ARB_provoking_vertex, 
    GL_ARB_query_buffer_object, GL_ARB_robust_buffer_access_behavior, 
    GL_ARB_robustness, GL_ARB_sample_shading, GL_ARB_sampler_objects, 
    GL_ARB_seamless_cube_map, GL_ARB_seamless_cubemap_per_texture, 
    GL_ARB_separate_shader_objects, GL_ARB_shader_atomic_counter_ops, 
    GL_ARB_shader_atomic_counters, GL_ARB_shader_ballot, 
    GL_ARB_shader_bit_encoding, GL_ARB_shader_clock, 
    GL_ARB_shader_draw_parameters, GL_ARB_shader_group_vote, 
    GL_ARB_shader_image_load_store, GL_ARB_shader_image_size, 
    GL_ARB_shader_objects, GL_ARB_shader_precision, 
    GL_ARB_shader_storage_buffer_object, GL_ARB_shader_subroutine, 
    GL_ARB_shader_texture_image_samples, GL_ARB_shader_texture_lod, 
    GL_ARB_shading_language_100, GL_ARB_shading_language_420pack, 
    GL_ARB_shading_language_include, GL_ARB_shading_language_packing, 
    GL_ARB_shadow, GL_ARB_sparse_buffer, GL_ARB_sparse_texture, 
    GL_ARB_stencil_texturing, GL_ARB_sync, GL_ARB_tessellation_shader, 
    GL_ARB_texture_barrier, GL_ARB_texture_border_clamp, 
    GL_ARB_texture_buffer_object, GL_ARB_texture_buffer_object_rgb32, 
    GL_ARB_texture_buffer_range, GL_ARB_texture_compression, 
    GL_ARB_texture_compression_bptc, GL_ARB_texture_compression_rgtc, 
    GL_ARB_texture_cube_map, GL_ARB_texture_cube_map_array, 
    GL_ARB_texture_env_add, GL_ARB_texture_env_combine, 
    GL_ARB_texture_env_crossbar, GL_ARB_texture_env_dot3, 
    GL_ARB_texture_float, GL_ARB_texture_gather, 
    GL_ARB_texture_mirror_clamp_to_edge, GL_ARB_texture_mirrored_repeat, 
    GL_ARB_texture_multisample, GL_ARB_texture_non_power_of_two, 
    GL_ARB_texture_query_levels, GL_ARB_texture_query_lod, 
    GL_ARB_texture_rectangle, GL_ARB_texture_rg, GL_ARB_texture_rgb10_a2ui, 
    GL_ARB_texture_stencil8, GL_ARB_texture_storage, 
    GL_ARB_texture_storage_multisample, GL_ARB_texture_swizzle, 
    GL_ARB_texture_view, GL_ARB_timer_query, GL_ARB_transform_feedback2, 
    GL_ARB_transform_feedback3, GL_ARB_transform_feedback_instanced, 
    GL_ARB_transform_feedback_overflow_query, GL_ARB_transpose_matrix, 
    GL_ARB_uniform_buffer_object, GL_ARB_vertex_array_bgra, 
    GL_ARB_vertex_array_object, GL_ARB_vertex_attrib_64bit, 
    GL_ARB_vertex_attrib_binding, GL_ARB_vertex_buffer_object, 
    GL_ARB_vertex_program, GL_ARB_vertex_shader, 
    GL_ARB_vertex_type_10f_11f_11f_rev, GL_ARB_vertex_type_2_10_10_10_rev, 
    GL_ARB_viewport_array, GL_ARB_window_pos, GL_ATI_draw_buffers, 
    GL_ATI_texture_float, GL_ATI_texture_mirror_once, 
    GL_EXTX_framebuffer_mixed_formats, GL_EXT_Cg_shader, GL_EXT_abgr, 
    GL_EXT_bgra, GL_EXT_bindable_uniform, GL_EXT_blend_color, 
    GL_EXT_blend_equation_separate, GL_EXT_blend_func_separate, 
    GL_EXT_blend_minmax, GL_EXT_blend_subtract, GL_EXT_compiled_vertex_array, 
    GL_EXT_depth_bounds_test, GL_EXT_direct_state_access, 
    GL_EXT_draw_buffers2, GL_EXT_draw_instanced, GL_EXT_draw_range_elements, 
    GL_EXT_fog_coord, GL_EXT_framebuffer_blit, GL_EXT_framebuffer_multisample, 
    GL_EXT_framebuffer_multisample_blit_scaled, GL_EXT_framebuffer_object, 
    GL_EXT_framebuffer_sRGB, GL_EXT_geometry_shader4, 
    GL_EXT_gpu_program_parameters, GL_EXT_gpu_shader4, 
    GL_EXT_import_sync_object, GL_EXT_multi_draw_arrays, 
    GL_EXT_packed_depth_stencil, GL_EXT_packed_float, GL_EXT_packed_pixels, 
    GL_EXT_pixel_buffer_object, GL_EXT_point_parameters, 
    GL_EXT_polygon_offset_clamp, GL_EXT_provoking_vertex, 
    GL_EXT_rescale_normal, GL_EXT_secondary_color, 
    GL_EXT_separate_shader_objects, GL_EXT_separate_specular_color, 
    GL_EXT_shader_image_load_formatted, GL_EXT_shader_image_load_store, 
    GL_EXT_shader_integer_mix, GL_EXT_shadow_funcs, GL_EXT_stencil_two_side, 
    GL_EXT_stencil_wrap, GL_EXT_texture3D, GL_EXT_texture_array, 
    GL_EXT_texture_buffer_object, GL_EXT_texture_compression_dxt1, 
    GL_EXT_texture_compression_latc, GL_EXT_texture_compression_rgtc, 
    GL_EXT_texture_compression_s3tc, GL_EXT_texture_cube_map, 
    GL_EXT_texture_edge_clamp, GL_EXT_texture_env_add, 
    GL_EXT_texture_env_combine, GL_EXT_texture_env_dot3, 
    GL_EXT_texture_filter_anisotropic, GL_EXT_texture_integer, 
    GL_EXT_texture_lod, GL_EXT_texture_lod_bias, GL_EXT_texture_mirror_clamp, 
    GL_EXT_texture_object, GL_EXT_texture_sRGB, GL_EXT_texture_sRGB_decode, 
    GL_EXT_texture_shared_exponent, GL_EXT_texture_storage, 
    GL_EXT_texture_swizzle, GL_EXT_timer_query, GL_EXT_transform_feedback2, 
    GL_EXT_vertex_array, GL_EXT_vertex_array_bgra, GL_EXT_vertex_attrib_64bit, 
    GL_EXT_window_rectangles, GL_EXT_x11_sync_object, GL_IBM_rasterpos_clip, 
    GL_IBM_texture_mirrored_repeat, GL_KHR_blend_equation_advanced, 
    GL_KHR_blend_equation_advanced_coherent, GL_KHR_context_flush_control, 
    GL_KHR_debug, GL_KHR_no_error, GL_KHR_robust_buffer_access_behavior, 
    GL_KHR_robustness, GL_KTX_buffer_region, GL_NVX_conditional_render, 
    GL_NVX_gpu_memory_info, GL_NVX_nvenc_interop, GL_NV_ES1_1_compatibility, 
    GL_NV_ES3_1_compatibility, GL_NV_alpha_to_coverage_dither_control, 
    GL_NV_bindless_multi_draw_indirect, 
    GL_NV_bindless_multi_draw_indirect_count, GL_NV_bindless_texture, 
    GL_NV_blend_equation_advanced, GL_NV_blend_equation_advanced_coherent, 
    GL_NV_blend_square, GL_NV_command_list, GL_NV_compute_program5, 
    GL_NV_conditional_render, GL_NV_copy_depth_to_color, GL_NV_copy_image, 
    GL_NV_depth_buffer_float, GL_NV_depth_clamp, GL_NV_draw_texture, 
    GL_NV_draw_vulkan_image, GL_NV_explicit_multisample, GL_NV_fence, 
    GL_NV_float_buffer, GL_NV_fog_distance, GL_NV_fragment_program, 
    GL_NV_fragment_program2, GL_NV_fragment_program_option, 
    GL_NV_framebuffer_multisample_coverage, GL_NV_geometry_shader4, 
    GL_NV_gpu_program4, GL_NV_gpu_program4_1, GL_NV_gpu_program5, 
    GL_NV_gpu_program5_mem_extended, GL_NV_gpu_program_fp64, 
    GL_NV_gpu_shader5, GL_NV_half_float, GL_NV_internalformat_sample_query, 
    GL_NV_light_max_exponent, GL_NV_multisample_coverage, 
    GL_NV_multisample_filter_hint, GL_NV_occlusion_query, 
    GL_NV_packed_depth_stencil, GL_NV_parameter_buffer_object, 
    GL_NV_parameter_buffer_object2, GL_NV_path_rendering, 
    GL_NV_pixel_data_range, GL_NV_point_sprite, GL_NV_primitive_restart, 
    GL_NV_register_combiners, GL_NV_register_combiners2, 
    GL_NV_robustness_video_memory_purge, GL_NV_shader_atomic_counters, 
    GL_NV_shader_atomic_float, GL_NV_shader_atomic_int64, 
    GL_NV_shader_buffer_load, GL_NV_shader_storage_buffer_object, 
    GL_NV_shader_thread_group, GL_NV_shader_thread_shuffle, 
    GL_NV_texgen_reflection, GL_NV_texture_barrier, 
    GL_NV_texture_compression_vtc, GL_NV_texture_env_combine4, 
    GL_NV_texture_multisample, GL_NV_texture_rectangle, GL_NV_texture_shader, 
    GL_NV_texture_shader2, GL_NV_texture_shader3, GL_NV_transform_feedback, 
    GL_NV_transform_feedback2, GL_NV_uniform_buffer_unified_memory, 
    GL_NV_vdpau_interop, GL_NV_vertex_array_range, GL_NV_vertex_array_range2, 
    GL_NV_vertex_attrib_integer_64bit, GL_NV_vertex_buffer_unified_memory, 
    GL_NV_vertex_program, GL_NV_vertex_program1_1, GL_NV_vertex_program2, 
    GL_NV_vertex_program2_option, GL_NV_vertex_program3, GL_S3_s3tc, 
    GL_SGIS_generate_mipmap, GL_SGIS_texture_lod, GL_SGIX_depth_texture, 
    GL_SGIX_shadow, GL_SUN_slice_accum

40 GLX Visuals
    visual  x   bf lv rg d st  colorbuffer  sr ax dp st accumbuffer  ms  cav
  id dep cl sp  sz l  ci b ro  r  g  b  a F gb bf th cl  r  g  b  a ns b eat
----------------------------------------------------------------------------
0x020 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x021 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0ae 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0af 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b0 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b1 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b2 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b3 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b4 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b5 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b6 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b7 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b8 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0b9 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0ba 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0bb 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0bc 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0bd 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0be 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0bf 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c0 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c1 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c2 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c3 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c4 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c5 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c6 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c7 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c8 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0c9 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0ca 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0cb 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0cc 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0cd 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0ce 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0cf 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0d0 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0d1 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0d2 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x06d 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None

215 GLXFBConfigs:
    visual  x   bf lv rg d st  colorbuffer  sr ax dp st accumbuffer  ms  cav
  id dep cl sp  sz l  ci b ro  r  g  b  a F gb bf th cl  r  g  b  a ns b eat
----------------------------------------------------------------------------
0x0a5 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0a6 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0a7 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x0a8 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x0a9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0aa 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0ab 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x0ac 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x0ad 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x0ae 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x0af 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x0b0 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x0b1 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x0b2 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x0b3 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x0b4 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x0b5 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x0b6 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x0b7 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x0b8 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x0b9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x0ba 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x0bb 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x0bc 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x0bd 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0be 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0bf 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c0 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c1 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0c2 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0c3 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0c4 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0c5 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c6 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c7 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c8 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x0c9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0ca 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0cb 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0cc 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x0cd 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0ce 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0cf 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d0 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d1 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0d2 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0d3 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0d4 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0d5 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d6 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d7 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d8 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x0d9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0da 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0db 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0dc 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x0dd 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0de 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0df 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e0 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e1 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e2 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e3 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e4 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x0e5 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0e6 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0e7 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0e8 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0e9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0ea 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0eb 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0ec 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x0ed 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0ee 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0ef 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f0 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f1 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f2 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f3 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f4 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x0f5 24 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0f6 24 dc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0f7 24 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0f8 24 dc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0f9 24 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0fa 24 dc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0fb 24 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0fc 24 dc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x0fd 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x0fe 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x0ff 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  0 0 None
0x100 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  0 0 None
0x101 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x102 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x103 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  0 0 None
0x104 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  0 0 None
0x105 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x106 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x107 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4  0  0 16 16 16 16  0 0 None
0x108 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4  0  0 16 16 16 16  0 0 None
0x109 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x10a 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x10b 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x10c 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x10d 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x10e 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  2 1 Ncon
0x10f 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x110 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  4 1 Ncon
0x111 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x112 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x113 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x114 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x115 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x116 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  2 1 Ncon
0x117 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x118 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  4 1 Ncon
0x119 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x11a 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x11b 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x11c 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16  8 1 Ncon
0x11d 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x11e 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x11f 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x120 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16  8 1 Ncon
0x121 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x122 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x123 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x124 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  0 16 16 16 16 16 1 Ncon
0x125 32 tc  0  24  0 r  y .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x126 32 tc  0  32  0 r  y .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x127 32 tc  0  24  0 r  . .   8  8  8  0 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x128 32 tc  0  32  0 r  . .   8  8  8  8 .  .  4 24  8 16 16 16 16 16 1 Ncon
0x129 24 sg  0  16  0 r  y .   5  6  5  0 .  .  4 16  0 16 16 16 16  0 0 None
0x12a 24 sg  0  16  0 r  . .   5  6  5  0 .  .  4 16  0 16 16 16 16  0 0 None
0x12b 24 sg  0  16  0 r  y .   5  6  5  0 .  .  4 24  0 16 16 16 16  0 0 None
0x12c 24 sg  0  16  0 r  . .   5  6  5  0 .  .  4 24  0 16 16 16 16  0 0 None
0x12d 24 sg  0  16  0 r  y .   5  6  5  0 .  .  4 24  8 16 16 16 16  0 0 None
0x12e 24 sg  0  16  0 r  . .   5  6  5  0 .  .  4 24  8 16 16 16 16  0 0 None
0x12f 24 sg  0  16  0 r  y .   5  6  5  0 .  .  4  0  0 16 16 16 16  0 0 None
0x130 24 sg  0  16  0 r  . .   5  6  5  0 .  .  4  0  0 16 16 16 16  0 0 None
0x131 24 sg  0   0  0 r  . .   0  0  0  0 .  .  4 16  0 16 16 16 16  0 0 None
0x132 24 sg  0   0  0 r  . .   0  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x133 24 sg  0   0  0 r  . .   0  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x134 24 sg  0  32  0 r  . .  16 16  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x135 24 sg  0  32  0    . .  16 16  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x136 24 sg  0  32  0 r  y .  16 16  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x137 24 sg  0  32  0    y .  16 16  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x138 24 sg  0  32  0 r  . .  32  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x139 24 sg  0  32  0    . .  32  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x13a 24 sg  0  32  0 r  y .  32  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x13b 24 sg  0  32  0    y .  32  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x13c 24 sg  0  64  0 r  . .  16 16 16 16 .  .  4  0  0 16 16 16 16  0 0 None
0x13d 24 sg  0  64  0    . .  16 16 16 16 .  .  4  0  0 16 16 16 16  0 0 None
0x13e 24 sg  0  64  0 r  y .  16 16 16 16 .  .  4  0  0 16 16 16 16  0 0 None
0x13f 24 sg  0  64  0    y .  16 16 16 16 .  .  4  0  0 16 16 16 16  0 0 None
0x140 24 sg  0 128  0 r  . .  32 32 32 32 .  .  4  0  0 16 16 16 16  0 0 None
0x141 24 sg  0 128  0    . .  32 32 32 32 .  .  4  0  0 16 16 16 16  0 0 None
0x142 24 sg  0 128  0 r  y .  32 32 32 32 .  .  4  0  0 16 16 16 16  0 0 None
0x143 24 sg  0 128  0    y .  32 32 32 32 .  .  4  0  0 16 16 16 16  0 0 None
0x144 24 sg  0  32  0 r  . .  16 16  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x145 24 sg  0  32  0    . .  16 16  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x146 24 sg  0  32  0 r  y .  16 16  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x147 24 sg  0  32  0    y .  16 16  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x148 24 sg  0  32  0 r  . .  16 16  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x149 24 sg  0  32  0    . .  16 16  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x14a 24 sg  0  32  0 r  y .  16 16  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x14b 24 sg  0  32  0    y .  16 16  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x14c 24 sg  0  32  0 r  . .  32  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x14d 24 sg  0  32  0    . .  32  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x14e 24 sg  0  32  0 r  y .  32  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x14f 24 sg  0  32  0    y .  32  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x150 24 sg  0  32  0 r  . .  32  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x151 24 sg  0  32  0    . .  32  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x152 24 sg  0  32  0 r  y .  32  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x153 24 sg  0  32  0    y .  32  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x154 24 sg  0  64  0 r  . .  16 16 16 16 .  .  4 24  0 16 16 16 16  0 0 None
0x155 24 sg  0  64  0    . .  16 16 16 16 .  .  4 24  0 16 16 16 16  0 0 None
0x156 24 sg  0  64  0 r  y .  16 16 16 16 .  .  4 24  0 16 16 16 16  0 0 None
0x157 24 sg  0  64  0    y .  16 16 16 16 .  .  4 24  0 16 16 16 16  0 0 None
0x158 24 sg  0  64  0 r  . .  16 16 16 16 .  .  4 24  8 16 16 16 16  0 0 None
0x159 24 sg  0  64  0    . .  16 16 16 16 .  .  4 24  8 16 16 16 16  0 0 None
0x15a 24 sg  0  64  0 r  y .  16 16 16 16 .  .  4 24  8 16 16 16 16  0 0 None
0x15b 24 sg  0  64  0    y .  16 16 16 16 .  .  4 24  8 16 16 16 16  0 0 None
0x15c 24 sg  0 128  0 r  . .  32 32 32 32 .  .  4 24  0 16 16 16 16  0 0 None
0x15d 24 sg  0 128  0    . .  32 32 32 32 .  .  4 24  0 16 16 16 16  0 0 None
0x15e 24 sg  0 128  0 r  y .  32 32 32 32 .  .  4 24  0 16 16 16 16  0 0 None
0x15f 24 sg  0 128  0    y .  32 32 32 32 .  .  4 24  0 16 16 16 16  0 0 None
0x160 24 sg  0 128  0 r  . .  32 32 32 32 .  .  4 24  8 16 16 16 16  0 0 None
0x161 24 sg  0 128  0    . .  32 32 32 32 .  .  4 24  8 16 16 16 16  0 0 None
0x162 24 sg  0 128  0 r  y .  32 32 32 32 .  .  4 24  8 16 16 16 16  0 0 None
0x163 24 sg  0 128  0    y .  32 32 32 32 .  .  4 24  8 16 16 16 16  0 0 None
0x164 24 sg  0  16  0 r  . .  16  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x165 24 sg  0  16  0    . .  16  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x166 24 sg  0  16  0 r  y .  16  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x167 24 sg  0  16  0    y .  16  0  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x168 24 sg  0  64  0 r  . .  32 32  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x169 24 sg  0  64  0    . .  32 32  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x16a 24 sg  0  64  0 r  y .  32 32  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x16b 24 sg  0  64  0    y .  32 32  0  0 .  .  4  0  0 16 16 16 16  0 0 None
0x16c 24 sg  0  16  0 r  . .  16  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x16d 24 sg  0  16  0    . .  16  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x16e 24 sg  0  16  0 r  y .  16  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x16f 24 sg  0  16  0    y .  16  0  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x170 24 sg  0  16  0 r  . .  16  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x171 24 sg  0  16  0    . .  16  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x172 24 sg  0  16  0 r  y .  16  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x173 24 sg  0  16  0    y .  16  0  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x174 24 sg  0  64  0 r  . .  32 32  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x175 24 sg  0  64  0    . .  32 32  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x176 24 sg  0  64  0 r  y .  32 32  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x177 24 sg  0  64  0    y .  32 32  0  0 .  .  4 24  0 16 16 16 16  0 0 None
0x178 24 sg  0  64  0 r  . .  32 32  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x179 24 sg  0  64  0    . .  32 32  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x17a 24 sg  0  64  0 r  y .  32 32  0  0 .  .  4 24  8 16 16 16 16  0 0 None
0x17b 24 sg  0  64  0    y .  32 32  0  0 .  .  4 24  8 16 16 16 16  0 0 None

And this is the output from nvidia-smi, after suspending.

Sun Aug 13 10:50:08 2017       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 384.59                 Driver Version: 384.59                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 860M    Off  | 00000000:01:00.0 Off |                  N/A |
| N/A   36C    P0    N/A /  N/A |      5MiB /  2002MiB |     23%      Default |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID  Type  Process name                               Usage      |
|=============================================================================|
|    0      2745    G   /usr/lib/xorg-server/Xorg                        4MiB |
+-----------------------------------------------------------------------------+

The first notable thing I could observe here is that the PID of the Xorg process keeps changing on each invocation of nvidia-smi (EDIT: That is normal, it's just how optirun works, spawning a new Xorg server at each invocation). The second, is that the card usage goes up to roughly 23% after suspend, when normally it is at 0%. However, running glxgears has a similar impact in the usage % before and after suspend. So, for example, if usually my load is at 0% and glxgears takes 60% GPU usage, after suspend, the value will be the 23% plus that 60%.

Next see whether a GPU reset helps (nvidia-smi -r)
Lastly, restart the X11 server and ensure the nvidia module gets unloaded at some point.

Using nvidia-smi -r doesn't seem to work, since the card is apparently being used by bumblebeed

$ optirun nvidia-smi -i 0 -r 
Unable to reset this GPU because it's being used by some other process (e.g. CUDA application, graphics application like X server, monitoring application like other instance of nvidia-smi). Please first kill all processes using this GPU and all compute applications running in the system (even when they are running on other GPUs) and then try to reset the GPU again.
Failed to reset Gpus.

However, if I stop the bumblebeed service and try this without optirun, the card is successfully reset. Then, without starting bumblebee, nvidia-smi shows 0% usage again. However, when I start the bumblebeed service again, and run optirun nvidia-smi, usage goes back up to 23%.

Restarting the X server with the bumblebee daemon active doesn't seem to help either.

EDIT: I also discovered the --no-xorg flag in optirun, which loads the nvidia module but doesn't create the separate Xorg server to render things into. That allows me to run "nvidia-smi -r" without stopping bumblebee, but the outcome is still the same. However, one additional thing I've noticed is that the usage when running "optirun --no-xorg nvidia-smi" is 0%. So we can confirm that the 24% usage comes from the Xorg server spawned by bumblebee.

EDIT2: I was looking at the dmesg output. Nothing catched my eye, but this is the relevant part of dmesg when launching a command through optirun:

bbswitch: enabling discrete graphics
nvidia-nvlink: Nvlink Core is being initialized, major device number 244
NVRM: loading NVIDIA UNIX x86_64 Kernel Module  384.59  Wed Jul 19 23:53:34 PDT 2017 (using threaded interrupts)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  384.59  Wed Jul 19 23:46:42 PDT 2017
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
nvidia-modeset: Unloading
nvidia-nvlink: Unregistered the Nvlink Core, major device number 244
bbswitch: disabling discrete graphics
ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20170303/nsarguments-95)
pci 0000:01:00.0: Refused to change power state, currently in D0

The "Refused to change power state" and ACPI warnings looked promising at first, but after googling it it seems that they are both common messages and they actually happen even if the performance problem is not present. The other relevant (?) thing is that the dmesg output is identical before and after suspension.

EDIT3: More findings, it seems that after going into S4 (hibernation) and back the performance problem goes away. I thought that might be relevant.

This is all I have for now, any ideas?

Last edited by setzer22 (2017-08-13 10:42:22)

Offline

Board footer

Powered by FluxBB