Llama-3.3-8B-Thinking-Gemini-Flash-11000x-128k

What madness is this?

Someone found "Llama3.3-8B" source (never publicly released) in the "wild", then it was adjusted back to 128k and then I added my own special madness by training the model with Unsloth (3 epochs) and Gemini-2.5-flash-11000x (11000 samples) dataset.

This has created an Thinking model (128k context, Llama 3.3 model) which REASONS / THINKS like Gemini, but in a Llama 3.3 8B model.

Note this tuning was not only to create an thinking model, but ALSO update some the model's core knowledge / root training.

1 example generation at the bottom of this page.

Some "Llama" issues may still exist including out-of-date data.

Thinking (will activate automatically) prompts - examples:

Explain orbital mechanics including detailed math and examples.

Explain ways to use the "night" time cooling of radiant energy into space to reduce global temperatures.

Think Deeply: Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. If the situation calls for it, have the character(s) curse and swear to further the reader's emotional connection to them. 800-1000 words.

Think deeply: Tell me a horror story.

[sometimes you don't need the "think deeply"]

EXTENDED:

Come up with a plan to write:

Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. If the situation calls for it, have the character(s) curse and swear to further the reader's emotional connection to them. 800-1000 words.

[ you may need to add after the "plan" appears: "Use the outline now, to write the scene"]

Certain phrases/words will automatically activate thinking:

  • explain
  • come up with a plan to...
  • write a ...
  • think about this and come up with a plan.

Instruct (thinking may NOT activate) prompts - examples:

Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. If the situation calls for it, have the character(s) curse and swear to further the reader's emotional connection to them. 800-1000 words.

Tell me a horror story.

SETTINGS (suggested):

Temp .7, rep pen 1.05, topp: .95, minp .05, topk: 40

Min context window: 4k, but suggest 8k+.

NO system prompt [thinking tags will self generate in MOST cases].

Strongly suggest Q4KS or higher // IQ3_M (Imatrix) or higher to avoid reasoning/reasoning activation issues.

SYSTEM PROMPT to "force" thinking (can lead to odd / interesting "output"):

A user will ask you to solve a task. You should first draft your thinking process (inner monologue) until you have derived the final answer. Afterwards, write a self-contained summary of your thoughts (i.e. your summary should be succinct but contain all the critical steps you needed to reach the conclusion). You should use Markdown and Latex to format your response. Write both your thoughts and summary in the same language as the task posed by the user.

Your thinking process must follow the template below:
<think>
Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate a correct answer.
</think>

Special thanks to:


https://huggingface.co/allura-forge/Llama-3.3-8B-Instruct (found the model!)

https://huggingface.co/shb777/Llama-3.3-8B-Instruct-128K (adjusted to 128k, and other fixes)

https://huggingface.co/datasets/TeichAI/claude-4.5-opus-high-reasoning-250x (for the F..ing amazing dataset)

and Unsloth for making tuning too easy:

https://github.com/unslothai/unsloth

Details on the "madness":

https://www.reddit.com/r/LocalLLaMA/comments/1pz7bmv/llama338binstruct/

https://www.reddit.com/r/LocalLLaMA/comments/1q06ddc/update_on_the_llama_33_8b_situation/


Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:

In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;

Set the "Smoothing_factor" to 1.5

: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"

: in text-generation-webui -> parameters -> lower right.

: In Silly Tavern this is called: "Smoothing"

NOTE: For "text-generation-webui"

-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)

Source versions (and config files) of my models are here:

https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be

OTHER OPTIONS:

  • Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")

  • If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This a "Class 1" model:

For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]


Example: Q4KS , Lmstudio, "suggested settings"

NOTE: Some loss of formatting.


Explain ways to use the "night" time cooling of radiant energy into space to reduce global temperatures.

[[[thinking start]]]

Analyzing Cooling Mechanisms

I'm currently focused on how we can leverage the natural cooling of radiant energy during nighttime hours. My goal is to identify practical methods for enhancing this process to mitigate global warming. I'm exploring specific techniques and strategies.

Evaluating Radiative Cooling Methods

Now, I'm digging into how different materials and surfaces can be used to enhance radiative cooling. I'm taking a close look at the spectral properties of various materials, especially their emissivity in infrared wavelengths. The goal is to find the best ways to maximize heat loss during nighttime hours.

Synthesizing Practical Applications

I've just finished a thorough brainstorming session on practical applications. I'm now prioritizing strategies that are most impactful, like large-scale urban planning. I'm focusing on how to integrate reflective surfaces and high-emissivity materials into existing infrastructure to maximize the cooling effect during nighttime hours. The ultimate goal is to devise actionable steps.

Prioritizing Strategic Implementation

I've been drilling down further into the specifics of implementation, particularly the "how." I am now considering the feasibility of each strategy, keeping in mind factors like cost, technology availability, and potential for widespread adoption. My focus is on creating a clear, actionable roadmap.

Developing an Actionable Roadmap

The work continues to center around building out a practical implementation guide. Currently, I'm focusing on refining the "how" behind each strategy, with a strong emphasis on feasibility. I am also exploring the potential for integrating multiple strategies into cohesive solutions, ensuring that they complement each other effectively.

Developing the Comprehensive Plan

I'm now deep in the process of building out the comprehensive plan. My focus is still on the practical side, specifically how to translate theoretical concepts into actionable steps. I've broken down my thoughts into distinct sections: surface design, urban planning, and global-scale strategies. I am refining each section, focusing on clarity and feasibility.

[[[thinking end]]]

OUTPUT:

The "night time cooling of radiant energy into space" is a natural process where the Earth's surface radiates heat back out into the vastness of space, primarily in the infrared (IR) spectrum. This process is essential for regulating Earth's temperature, but it is naturally more efficient during the night due to several factors:

  • Less Atmospheric Absorption: During the day, a significant portion of outgoing IR radiation is absorbed by greenhouse gases in the atmosphere (like CO2 and water vapor), preventing it from escaping to space. At night, there's less thermal energy generated by the sun to be absorbed, leading to less overall atmospheric absorption.
  • Higher Temperature Gradient: The surface temperature drops significantly overnight while the outer atmosphere remains relatively cold, creating a stronger temperature gradient for heat loss.

To leverage this natural process and reduce global temperatures, strategies often revolve around enhancing the Earth's ability to radiate heat more efficiently into space, especially during the cooler nighttime hours. While "night time cooling" isn't a direct cause of temperature reduction (it's a natural phenomenon itself), strategies that enhance the efficacy of this natural process contribute to it.

Here are ways to use and enhance this natural cooling mechanism:

  1. Surface Design & Materials (Local & Regional)

The most straightforward way to enhance radiative cooling is by designing surfaces and buildings that emit infrared radiation more efficiently than standard materials.

  • High Emissivity Materials: Using materials with very high emissivity (close to 1) in the IR spectrum, especially in the 8-14 µm range. Examples include:
  • White/Albedo Coatings: High-albedo (reflective) surfaces are often used in conjunction with high emissivity. While the white reflects visible light and absorbs less solar radiation, it also provides a large surface area for IR emission.
  • Specialized Coatings/Paints: Some coatings can be engineered to have extremely high IR emissivity while also being durable and aesthetically pleasing.
  • Optical Brighteners (OBs): Incorporating specific optical brighteners into building materials (e.g., concrete, paint) can dramatically increase IR emissivity without changing visible color.

Structural Designs:

  • Cooling Facades: Designing building facades with specific geometric shapes or materials that create "cold spots" by reflecting sunlight and emitting IR radiation more effectively than the surrounding environment.
  • Dome-Shaped Structures: A dome shape allows sunlight to be reflected upwards and outwards, while the underside of the dome is exposed to a relatively cooler sky for radiative emission.
  • Passive Radiative Cooling Systems: These systems often involve a network of "cooling panels" or "evaporative cooling towers" that are designed to radiate heat downwards towards a reflective surface (like water or a highly reflective material) and then outwards into the sky.
  • Cooling Tiles/Pavers: Using specialized pavers that absorb and store heat during the day, then radiate it out to the sky at night.
  1. Urban Planning & Green Infrastructure (Regional)

Cities are massive heat sinks, and their surfaces often have high thermal emissivity due to dark materials like asphalt and concrete.

  • Green Roofs & Walls: Covering rooftops and walls with vegetation significantly reduces surface temperature, acting as a "cool sponge." This lower surface temperature then radiates less energy into the atmosphere during the day but also means there's more efficient cooling available at night.
  • Albedo-Enhancing Pavement: Using lighter-colored asphalt or concrete for roads and sidewalks can reflect more solar radiation and also contribute to IR emission.
  • Reflective Surfaces: Incorporating large areas of highly reflective surfaces (e.g., polished stainless steel, white glass) into urban environments can not only reflect sunlight but also provide a larger surface area for IR emission at night.
  • Water Features: Incorporating large bodies of water (lakes, reservoirs, even extensive fountains) into urban landscapes is highly effective. Water has a very high IR emissivity and can absorb and release heat slowly, helping to cool the surrounding air through evaporation and direct radiative transfer.
  1. Agricultural Practices (Global)

Agricultural land surfaces represent a significant portion of the Earth's surface.

  • Lighter Crop Strips: Interspersing strips of lighter-colored crops or reflective mulch among darker plants can increase the overall albedo of agricultural fields, reflecting more sunlight and allowing for greater nighttime radiative cooling from the entire area.
  • Optical Brightener Mulch: Similar to OBs in materials, specialized optical brighteners can be incorporated into mulch or irrigation water to increase the IR emissivity of soil surfaces.
  • Reduced Tillage Practices: Minimizing disturbance to soil can reduce its thermal conductivity and increase its surface temperature at night, allowing for more efficient radiative cooling.
  1. Global Atmospheric Modification (Highly Experimental & Ethical Considerations)

These are very large-scale, highly complex, and often ethically contentious strategies that aim to change the atmospheric properties to allow for greater radiative cooling.

  • Stratospheric Aerosol Injection (SAI): Injecting small particles into the stratosphere to increase solar radiation scattering back into space. While primarily a solar radiation management (SRM) technique, SAI can indirectly enhance nighttime radiative cooling by reducing the overall atmospheric temperature and thus the "backradiation" that opposes surface cooling.
  • Atmospheric Ionic Manipulation/Cloud Seeding: Some theoretical ideas suggest manipulating the ion composition of the atmosphere or cloud formation to make clouds more reflective or to create persistent cirrus clouds (which reflect more sunlight and have higher IR emissivity) over land. However, these are highly speculative and carry significant unknown risks.
  1. Space-Based Reflectors (Hypothetical)

While not directly "night time cooling," a hypothetical array of large space-based reflectors could potentially increase the Earth's overall albedo by reflecting more solar radiation back into space, thereby preventing it from warming the atmosphere and the surface in the first place. This would indirectly lead to a greater ability for the Earth to radiatively cool at night, as there would be less excess heat generated during the day.

Key Considerations & Challenges:

  • Spectral Matching: Ensuring that the materials used emit IR radiation effectively within the atmospheric windows where there is minimal absorption.
  • Atmospheric Dynamics: The effectiveness of radiative cooling can be affected by wind patterns (dissipating boundary layers), humidity, and even aerosols.
  • Economics & Implementation: Many of these methods require significant investment in research, development, and deployment. Scaling up from local experiments to global impact is a major hurdle.
  • Ethical & Governance Issues: Large-scale geoengineering projects, especially those with atmospheric or solar modification, raise complex ethical questions about responsibility, potential unintended consequences, and international agreements.
  • Complementary Strategies: Radiative cooling often works best in conjunction with other climate change mitigation strategies (e.g., reducing greenhouse gas emissions, increasing energy efficiency) rather than as a standalone solution.

In summary, leveraging the "night time cooling of radiant energy into space" involves designing surfaces and landscapes to radiate heat more efficiently into the vast IR sink of space, especially during the nighttime hours when atmospheric absorption is less of an issue. This can be achieved through material science innovations, urban planning, and even large-scale agricultural practices, always keeping in mind the complex interplay with Earth's atmosphere and the ethical implications of global climate engineering.

Downloads last month
12
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DavidAU/Llama-3.3-8B-Thinking-Gemini-Flash-11000x-128k

Finetuned
(5)
this model
Quantizations
4 models

Dataset used to train DavidAU/Llama-3.3-8B-Thinking-Gemini-Flash-11000x-128k

Collections including DavidAU/Llama-3.3-8B-Thinking-Gemini-Flash-11000x-128k